[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:54:38 dist-test-slave-qg60 krb5kdc[2820](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:54:38 dist-test-slave-qg60 krb5kdc[2820](info): set up 2 sockets
Aug 08 05:54:38 dist-test-slave-qg60 krb5kdc[2820](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 05:54:39.198182 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.008s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:54:39 dist-test-slave-qg60 krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:54:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:54:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:54:39.340426 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:38745
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:38745
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:39.460690 2835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:39.461000 2835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:39.461082 2835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:39.465209 2835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:54:39.465269 2835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:39.465288 2835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:39.465351 2835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:54:39.465390 2835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:54:39.471230 2835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:38745
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:38745
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:39.472437 2835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:39.473536 2835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:39.483253 2841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:39.483223 2843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:39.483233 2840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:39.483631 2835 server_base.cc:1034] running on GCE node
I20260808 05:54:39.484314 2835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:39.485842 2835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:39.487105 2835 hybrid_clock.cc:648] HybridClock initialized: now 1786168479487074 us; error 89 us; skew 500 ppm
Aug 08 05:54:39 dist-test-slave-qg60 krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168479, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:39.496042 2835 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:54:39.497157 2835 webserver.cc:460] Webserver started at http://127.2.191.126:37099/ using document root <none> and password file <none>
I20260808 05:54:39.497725 2835 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:39.497786 2835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:39.497982 2835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:39.500502 2835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "ede290b6df3d4384a1866a02481765e7"
format_stamp: "Formatted at 2026-08-08 05:54:39 on dist-test-slave-qg60"
server_key: "38e20224959adaa7a81e18c3e3815231"
server_key_iv: "1d3f0b97a6d541f53761e50a5e110fd9"
server_key_version: "encryptionkey@0"
I20260808 05:54:39.501250 2835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "ede290b6df3d4384a1866a02481765e7"
format_stamp: "Formatted at 2026-08-08 05:54:39 on dist-test-slave-qg60"
server_key: "38e20224959adaa7a81e18c3e3815231"
server_key_iv: "1d3f0b97a6d541f53761e50a5e110fd9"
server_key_version: "encryptionkey@0"
I20260808 05:54:39.505280 2835 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:54:39.507820 2852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:39.509207 2835 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:54:39.509349 2835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "ede290b6df3d4384a1866a02481765e7"
format_stamp: "Formatted at 2026-08-08 05:54:39 on dist-test-slave-qg60"
server_key: "38e20224959adaa7a81e18c3e3815231"
server_key_iv: "1d3f0b97a6d541f53761e50a5e110fd9"
server_key_version: "encryptionkey@0"
I20260808 05:54:39.509461 2835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:39.538753 2835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:39.542480 2835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:39.542884 2835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:39.557022 2835 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:38745
I20260808 05:54:39.557132 2911 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:38745 every 8 connection(s)
I20260808 05:54:39.558183 2835 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:54:39.560108 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 2835
I20260808 05:54:39.560285 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:54:39.561506 2912 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:39.561731 2813 external_mini_cluster.cc:1428] Setting key 12c8280ebfb0f08d823432e9c9ab781b
I20260808 05:54:39.567938 2912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7: Bootstrap starting.
I20260808 05:54:39.570336 2912 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:39.571086 2912 log.cc:824] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:39.573277 2912 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7: No bootstrap required, opened a new log
I20260808 05:54:39.577361 2912 raft_consensus.cc:348] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede290b6df3d4384a1866a02481765e7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38745 } }
I20260808 05:54:39.577625 2912 raft_consensus.cc:374] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:39.577682 2912 raft_consensus.cc:729] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ede290b6df3d4384a1866a02481765e7, State: Initialized, Role: FOLLOWER
I20260808 05:54:39.578179 2912 consensus_queue.cc:260] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede290b6df3d4384a1866a02481765e7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38745 } }
I20260808 05:54:39.578315 2912 raft_consensus.cc:388] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:54:39.578408 2912 raft_consensus.cc:482] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:54:39.578526 2912 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:39.579566 2912 raft_consensus.cc:504] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede290b6df3d4384a1866a02481765e7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38745 } }
I20260808 05:54:39.579926 2912 leader_election.cc:302] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ede290b6df3d4384a1866a02481765e7; no voters:
I20260808 05:54:39.580327 2912 leader_election.cc:288] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:54:39.580446 2917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:39.580823 2917 raft_consensus.cc:686] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [term 1 LEADER]: Becoming Leader. State: Replica: ede290b6df3d4384a1866a02481765e7, State: Running, Role: LEADER
I20260808 05:54:39.581226 2917 consensus_queue.cc:237] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede290b6df3d4384a1866a02481765e7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38745 } }
I20260808 05:54:39.581754 2912 sys_catalog.cc:564] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:54:39.583487 2919 sys_catalog.cc:455] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ede290b6df3d4384a1866a02481765e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede290b6df3d4384a1866a02481765e7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38745 } } }
I20260808 05:54:39.583662 2919 sys_catalog.cc:458] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:39.584118 2918 sys_catalog.cc:455] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ede290b6df3d4384a1866a02481765e7. Latest consensus state: current_term: 1 leader_uuid: "ede290b6df3d4384a1866a02481765e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ede290b6df3d4384a1866a02481765e7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38745 } } }
I20260808 05:54:39.584205 2918 sys_catalog.cc:458] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:39.584836 2932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 08 05:54:39 dist-test-slave-qg60 krb5kdc[2820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168479, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:39.588692 2932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:54:39.592092 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:39.565788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38828 (local address 127.2.191.126:38745)
0808 05:54:39.566412 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:39.566462 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:39.569638 (+ 3176us) server_negotiation.cc:407] Connection header received
0808 05:54:39.573184 (+ 3546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:39.573204 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:39.573733 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:39.574077 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:39.576368 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:39.577948 (+ 1580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:39.579428 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:39.580103 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:39.580295 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:39.586450 (+ 6155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:39.586485 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:39.586498 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:39.586528 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:39.588368 (+ 1840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:39.589093 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:39.589099 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:39.589102 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:39.589223 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:39.589589 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:39.589598 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:39.589599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:39.589982 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:39.590201 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:39.590854 (+ 653us) server_negotiation.cc:299] Negotiation successful
0808 05:54:39.591150 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":145,"threads_started":1}
I20260808 05:54:39.596374 2932 catalog_manager.cc:1347] Generated new cluster ID: 6006d19672bb4456bf097514364194ec
I20260808 05:54:39.596446 2932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:54:39.602370 2932 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:54:39.603354 2932 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:54:39.615173 2932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ede290b6df3d4384a1866a02481765e7: Generated new TSK 0
I20260808 05:54:39.616060 2932 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:54:39.660319 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38745
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:39.806658 2941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:39.806919 2941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:39.807010 2941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:39.811136 2941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:39.811210 2941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:39.811317 2941 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:54:39.816802 2941 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38745
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:39.818048 2941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:39.819110 2941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:39.829571 2949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:39.829540 2947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:39.829704 2946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:39.829802 2941 server_base.cc:1034] running on GCE node
I20260808 05:54:39.830358 2941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:39.830956 2941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:39.832115 2941 hybrid_clock.cc:648] HybridClock initialized: now 1786168479832084 us; error 44 us; skew 500 ppm
Aug 08 05:54:39 dist-test-slave-qg60 krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168479, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:39.835399 2941 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:54:39.836318 2941 webserver.cc:460] Webserver started at http://127.2.191.65:37609/ using document root <none> and password file <none>
I20260808 05:54:39.836952 2941 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:39.837044 2941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:39.837282 2941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:39.839445 2941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "16786e9fb4ea4d648f719167eeaecf9b"
format_stamp: "Formatted at 2026-08-08 05:54:39 on dist-test-slave-qg60"
server_key: "ef642cb12d6230bb38fc025a69b4fd34"
server_key_iv: "cfa2b235400f15f199ea9e22d0068a97"
server_key_version: "encryptionkey@0"
I20260808 05:54:39.840044 2941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "16786e9fb4ea4d648f719167eeaecf9b"
format_stamp: "Formatted at 2026-08-08 05:54:39 on dist-test-slave-qg60"
server_key: "ef642cb12d6230bb38fc025a69b4fd34"
server_key_iv: "cfa2b235400f15f199ea9e22d0068a97"
server_key_version: "encryptionkey@0"
I20260808 05:54:39.843994 2941 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:54:39.846680 2956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:39.847926 2941 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:54:39.848070 2941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "16786e9fb4ea4d648f719167eeaecf9b"
format_stamp: "Formatted at 2026-08-08 05:54:39 on dist-test-slave-qg60"
server_key: "ef642cb12d6230bb38fc025a69b4fd34"
server_key_iv: "cfa2b235400f15f199ea9e22d0068a97"
server_key_version: "encryptionkey@0"
I20260808 05:54:39.848227 2941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:39.861656 2941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:39.865141 2941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:39.865379 2941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:39.866117 2941 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:39.867046 2941 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:39.867120 2941 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:39.867221 2941 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:39.867272 2941 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:39.882215 2941 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:41521
I20260808 05:54:39.882232 3080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:41521 every 8 connection(s)
I20260808 05:54:39.883420 2941 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:54:39.889000 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 2941
I20260808 05:54:39.889133 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:54:39.889395 2813 external_mini_cluster.cc:1428] Setting key c54e069b07481a9112d62870439ed71e
Aug 08 05:54:39 dist-test-slave-qg60 krb5kdc[2820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168479, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:39.900063 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:39.885449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:46209 (local address 127.2.191.126:38745)
0808 05:54:39.885600 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:39.885604 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:39.886570 (+ 966us) server_negotiation.cc:407] Connection header received
0808 05:54:39.888144 (+ 1574us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:39.888148 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:39.888210 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:39.888317 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:39.889976 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:39.890611 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:39.891899 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:39.892309 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:39.892438 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:39.895571 (+ 3133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:39.895577 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:39.895584 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:39.895618 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:39.897574 (+ 1956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:39.898143 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:39.898150 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:39.898154 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:39.898267 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:39.898672 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:39.898678 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:39.898682 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:39.899015 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:39.899145 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:39.899658 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 05:54:39.899840 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 05:54:39.900934 3083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:39.885860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38745 (local address 127.2.191.65:46209)
0808 05:54:39.886419 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:39.886463 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:39.887862 (+ 1399us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:39.888504 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:39.888511 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:39.889057 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:39.889776 (+ 719us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:39.889818 (+ 42us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:39.890790 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:39.890794 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:39.891771 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:39.891782 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:39.892469 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:39.892471 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:39.892625 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:39.893442 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:39.893469 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:39.895392 (+ 1923us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:39.897703 (+ 2311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:39.897708 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:39.897721 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:39.897983 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:39.898396 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:39.898399 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:39.898400 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:39.898563 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:39.899132 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:39.899138 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:39.899383 (+ 245us) client_negotiation.cc:769] Sending connection context
0808 05:54:39.899569 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 05:54:39.899838 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":170,"threads_started":1}
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:54:39.902249 3081 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38745
I20260808 05:54:39.902513 3081 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:39.903071 3081 heartbeater.cc:511] Master 127.2.191.126:38745 requested a full tablet report, sending...
I20260808 05:54:39.904687 2870 ts_manager.cc:194] Registered new tserver with Master: 16786e9fb4ea4d648f719167eeaecf9b (127.2.191.65:41521)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:54:39.906473 2870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:46209
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:54:39.924566 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38745
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:40.053848 3086 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:40.054198 3086 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:40.054273 3086 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:40.058480 3086 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:40.058562 3086 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:40.058652 3086 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:54:40.064175 3086 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38745
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3086
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:40.065354 3086 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:40.066391 3086 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:40.077145 3092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:40.077265 3086 server_base.cc:1034] running on GCE node
W20260808 05:54:40.077155 3094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:40.077482 3091 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:40.078039 3086 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:40.078742 3086 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:40.079928 3086 hybrid_clock.cc:648] HybridClock initialized: now 1786168480079902 us; error 48 us; skew 500 ppm
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168480, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:40.083455 3086 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:54:40.084560 3086 webserver.cc:460] Webserver started at http://127.2.191.66:34793/ using document root <none> and password file <none>
I20260808 05:54:40.085203 3086 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:40.085300 3086 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:40.085541 3086 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:40.087661 3086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "6d66f41793514925a38bb72bddb52923"
format_stamp: "Formatted at 2026-08-08 05:54:40 on dist-test-slave-qg60"
server_key: "277e501f8ec40e746231785da4cf1d5e"
server_key_iv: "3eafe50823c7d98fa8ab84aecf59b33a"
server_key_version: "encryptionkey@0"
I20260808 05:54:40.088299 3086 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "6d66f41793514925a38bb72bddb52923"
format_stamp: "Formatted at 2026-08-08 05:54:40 on dist-test-slave-qg60"
server_key: "277e501f8ec40e746231785da4cf1d5e"
server_key_iv: "3eafe50823c7d98fa8ab84aecf59b33a"
server_key_version: "encryptionkey@0"
I20260808 05:54:40.092357 3086 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260808 05:54:40.095135 3101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:40.096532 3086 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:40.096668 3086 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "6d66f41793514925a38bb72bddb52923"
format_stamp: "Formatted at 2026-08-08 05:54:40 on dist-test-slave-qg60"
server_key: "277e501f8ec40e746231785da4cf1d5e"
server_key_iv: "3eafe50823c7d98fa8ab84aecf59b33a"
server_key_version: "encryptionkey@0"
I20260808 05:54:40.096848 3086 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:40.114810 3086 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:40.118602 3086 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:40.118813 3086 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:40.119504 3086 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:40.120389 3086 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:40.120447 3086 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:40.120517 3086 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:40.120553 3086 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:40.134817 3086 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:44229
I20260808 05:54:40.134837 3228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:44229 every 8 connection(s)
I20260808 05:54:40.135815 3086 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:54:40.143217 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 3086
I20260808 05:54:40.143352 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:54:40.143602 2813 external_mini_cluster.cc:1428] Setting key 0d547a35a4ee245e481b52778ee53774
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[2820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168480, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:40.153466 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:40.138607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:49971 (local address 127.2.191.126:38745)
0808 05:54:40.138799 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:40.138807 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:40.139783 (+ 976us) server_negotiation.cc:407] Connection header received
0808 05:54:40.142203 (+ 2420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:40.142206 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:40.142261 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:40.142331 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:40.144307 (+ 1976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.145015 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.146265 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.146521 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.146640 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:40.149526 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:40.149530 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:40.149532 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:40.149561 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:40.151205 (+ 1644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:40.151734 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:40.151737 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:40.151739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:40.151854 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:40.152239 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:40.152242 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:40.152243 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:40.152431 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:40.152539 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:40.153161 (+ 622us) server_negotiation.cc:299] Negotiation successful
0808 05:54:40.153298 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 05:54:40.154321 3231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:40.138976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38745 (local address 127.2.191.66:49971)
0808 05:54:40.139557 (+ 581us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:40.139636 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:40.141890 (+ 2254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:40.142609 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:40.142621 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:40.143279 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:40.144143 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:40.144162 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.145169 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.145172 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:40.146122 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:40.146132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.146689 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.146694 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:40.146859 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:40.147560 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:40.147576 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:40.149333 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:40.151346 (+ 2013us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:40.151352 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:40.151372 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:40.151619 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:40.151939 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:40.151944 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:40.151946 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:40.152134 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:40.152536 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:40.152543 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:40.152863 (+ 320us) client_negotiation.cc:769] Sending connection context
0808 05:54:40.153093 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 05:54:40.153428 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":134,"threads_started":1}
I20260808 05:54:40.155556 3229 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38745
I20260808 05:54:40.155844 3229 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:54:40.156531 3229 heartbeater.cc:511] Master 127.2.191.126:38745 requested a full tablet report, sending...
I20260808 05:54:40.157662 2870 ts_manager.cc:194] Registered new tserver with Master: 6d66f41793514925a38bb72bddb52923 (127.2.191.66:44229)
I20260808 05:54:40.158269 2870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:49971
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:54:40.177031 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38745
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:39169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:40.298939 3234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:40.299213 3234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:40.299291 3234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:40.303603 3234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:40.303665 3234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:40.303767 3234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:54:40.309301 3234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:39169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38745
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:40.310410 3234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:40.311492 3234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:40.322288 3239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:40.322337 3242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:40.322281 3240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:40.322367 3234 server_base.cc:1034] running on GCE node
I20260808 05:54:40.323010 3234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:40.323655 3234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:40.324826 3234 hybrid_clock.cc:648] HybridClock initialized: now 1786168480324792 us; error 44 us; skew 500 ppm
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168480, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:40.328253 3234 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:54:40.329401 3234 webserver.cc:460] Webserver started at http://127.2.191.67:33369/ using document root <none> and password file <none>
I20260808 05:54:40.330044 3234 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:40.330145 3234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:40.330394 3234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:40.332811 3234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "9e168a1d65cf48c59fc27889d1fccbb5"
format_stamp: "Formatted at 2026-08-08 05:54:40 on dist-test-slave-qg60"
server_key: "d1a1bbe9ad0b1941a53d637e8e5f4b8d"
server_key_iv: "ce10b96abe028b3358ac0cbc152c8750"
server_key_version: "encryptionkey@0"
I20260808 05:54:40.333431 3234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "9e168a1d65cf48c59fc27889d1fccbb5"
format_stamp: "Formatted at 2026-08-08 05:54:40 on dist-test-slave-qg60"
server_key: "d1a1bbe9ad0b1941a53d637e8e5f4b8d"
server_key_iv: "ce10b96abe028b3358ac0cbc152c8750"
server_key_version: "encryptionkey@0"
I20260808 05:54:40.337541 3234 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:54:40.339970 3249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:40.341547 3234 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 05:54:40.341681 3234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "9e168a1d65cf48c59fc27889d1fccbb5"
format_stamp: "Formatted at 2026-08-08 05:54:40 on dist-test-slave-qg60"
server_key: "d1a1bbe9ad0b1941a53d637e8e5f4b8d"
server_key_iv: "ce10b96abe028b3358ac0cbc152c8750"
server_key_version: "encryptionkey@0"
I20260808 05:54:40.341796 3234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:40.352924 3234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:40.356268 3234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:40.356545 3234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:40.357353 3234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:40.358264 3234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:40.358336 3234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:40.358402 3234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:40.358443 3234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:40.372575 3234 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:35335
I20260808 05:54:40.372642 3374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:35335 every 8 connection(s)
I20260808 05:54:40.373638 3234 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:54:40.374475 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 3234
I20260808 05:54:40.374622 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:54:40.374894 2813 external_mini_cluster.cc:1428] Setting key fb8b91c38721336b8f174954a47561a7
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[2820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168480, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:40.389093 2914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:40.375808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:46055 (local address 127.2.191.126:38745)
0808 05:54:40.375942 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:40.375946 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:40.377131 (+ 1185us) server_negotiation.cc:407] Connection header received
0808 05:54:40.378723 (+ 1592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:40.378726 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:40.378772 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:40.378840 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:40.380125 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.380674 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.382034 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.382260 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.382343 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:40.385316 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:40.385320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:40.385322 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:40.385346 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:40.386759 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:40.387294 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:40.387297 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:40.387298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:40.387372 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:40.387709 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:40.387714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:40.387716 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:40.387921 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:40.388030 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:40.388791 (+ 761us) server_negotiation.cc:299] Negotiation successful
0808 05:54:40.388941 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:54:40.390061 3377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:40.376316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38745 (local address 127.2.191.67:46055)
0808 05:54:40.376962 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:40.377021 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:40.378531 (+ 1510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:40.379001 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:40.379007 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:40.379434 (+ 427us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:40.379989 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:40.380005 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.380864 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.380866 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:40.381904 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:40.381914 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.382449 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.382453 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:40.382658 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:40.383471 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:40.383499 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:40.385153 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:40.386884 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:40.386891 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:40.386906 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:40.387173 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:40.387463 (+ 290us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:40.387466 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:40.387468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:40.387610 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:40.388087 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:40.388093 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:40.388402 (+ 309us) client_negotiation.cc:769] Sending connection context
0808 05:54:40.388625 (+ 223us) client_negotiation.cc:240] Negotiation successful
0808 05:54:40.389049 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":176,"threads_started":1}
I20260808 05:54:40.391197 3375 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38745
I20260808 05:54:40.391467 3375 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:40.391970 3375 heartbeater.cc:511] Master 127.2.191.126:38745 requested a full tablet report, sending...
I20260808 05:54:40.393059 2870 ts_manager.cc:194] Registered new tserver with Master: 9e168a1d65cf48c59fc27889d1fccbb5 (127.2.191.67:35335)
I20260808 05:54:40.393667 2870 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:46055
I20260808 05:54:40.401460 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168480, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[2820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168480, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:54:40.431061 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:40.421045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55704 (local address 127.2.191.65:41521)
0808 05:54:40.421356 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:40.421363 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:40.421492 (+ 129us) server_negotiation.cc:407] Connection header received
0808 05:54:40.421619 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:40.421626 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:40.421839 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:40.421963 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:40.422770 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.423549 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.424402 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.424925 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.425012 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:40.427721 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:40.427730 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:40.427743 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:40.427768 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:40.429466 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:40.429869 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:40.429874 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:40.429875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:40.429955 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:40.430220 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:40.430222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:40.430223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:40.430462 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:40.430624 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:40.430767 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:54:40.430891 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":131,"threads_started":1}
W20260808 05:54:40.432045 2987 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55704
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[2820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[2820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168480, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:54:40.461509 3382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:40.452447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55712 (local address 127.2.191.65:41521)
0808 05:54:40.452655 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:40.452659 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:40.452869 (+ 210us) server_negotiation.cc:407] Connection header received
0808 05:54:40.452993 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:40.452997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:40.453056 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:40.453149 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:40.453892 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.454505 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.455325 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:40.455600 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:40.455694 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:40.458400 (+ 2706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:40.458404 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:40.458406 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:40.458431 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:40.459875 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:40.460321 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:40.460324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:40.460325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:40.460408 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:40.460691 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:40.460693 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:40.460694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:40.460955 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:40.461169 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:40.461276 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:54:40.461375 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 05:54:40.462700 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 2941
I20260808 05:54:40.470467 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 3086
I20260808 05:54:40.477411 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 3234
I20260808 05:54:40.483321 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 2835
2026-08-08T05:54:40Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2458 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[3389](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[3389](info): set up 2 sockets
Aug 08 05:54:40 dist-test-slave-qg60 krb5kdc[3389](info): commencing operation
krb5kdc: starting...
W20260808 05:54:41.650178 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:54:41 dist-test-slave-qg60 krb5kdc[3389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:54:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:54:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:54:41.788137 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:38669
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:46133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:38669
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:41.905889 3403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:41.906208 3403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:41.906296 3403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:41.910521 3403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:54:41.910601 3403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:41.910640 3403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:41.910699 3403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:54:41.910738 3403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:54:41.916097 3403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:46133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:38669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:38669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3403
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:41.917296 3403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:41.918380 3403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:41.927049 3408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:41.927125 3411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:41.927091 3409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:41.927361 3403 server_base.cc:1034] running on GCE node
I20260808 05:54:41.927966 3403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:41.929227 3403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:41.930401 3403 hybrid_clock.cc:648] HybridClock initialized: now 1786168481930379 us; error 34 us; skew 500 ppm
Aug 08 05:54:41 dist-test-slave-qg60 krb5kdc[3389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168481, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:41.933269 3403 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:54:41.934239 3403 webserver.cc:460] Webserver started at http://127.2.191.126:39995/ using document root <none> and password file <none>
I20260808 05:54:41.934767 3403 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:41.934825 3403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:41.934990 3403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:41.937155 3403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "350dcc19d22b41ab89d1d0135672d71d"
format_stamp: "Formatted at 2026-08-08 05:54:41 on dist-test-slave-qg60"
server_key: "90c7d4fcab131759278333eabef12758"
server_key_iv: "ebe0f545fc03e3a88b7bdf53c65f9006"
server_key_version: "encryptionkey@0"
I20260808 05:54:41.937692 3403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "350dcc19d22b41ab89d1d0135672d71d"
format_stamp: "Formatted at 2026-08-08 05:54:41 on dist-test-slave-qg60"
server_key: "90c7d4fcab131759278333eabef12758"
server_key_iv: "ebe0f545fc03e3a88b7bdf53c65f9006"
server_key_version: "encryptionkey@0"
I20260808 05:54:41.941520 3403 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:54:41.943990 3419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:41.945356 3403 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:54:41.945531 3403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "350dcc19d22b41ab89d1d0135672d71d"
format_stamp: "Formatted at 2026-08-08 05:54:41 on dist-test-slave-qg60"
server_key: "90c7d4fcab131759278333eabef12758"
server_key_iv: "ebe0f545fc03e3a88b7bdf53c65f9006"
server_key_version: "encryptionkey@0"
I20260808 05:54:41.945634 3403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:41.957511 3403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:41.960537 3403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:41.960804 3403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:41.968428 3403 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:38669
I20260808 05:54:41.968452 3478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:38669 every 8 connection(s)
I20260808 05:54:41.969569 3403 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:54:41.972369 3480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:41.975379 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 3403
I20260808 05:54:41.975473 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:54:41.975749 2813 external_mini_cluster.cc:1428] Setting key baedfed681393d730da919c094db0d72
I20260808 05:54:41.978446 3480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d: Bootstrap starting.
I20260808 05:54:41.980652 3480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:41.981460 3480 log.cc:824] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:41.983819 3480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d: No bootstrap required, opened a new log
Aug 08 05:54:41 dist-test-slave-qg60 krb5kdc[3389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:41.988148 3480 raft_consensus.cc:348] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350dcc19d22b41ab89d1d0135672d71d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38669 } }
I20260808 05:54:41.988437 3480 raft_consensus.cc:374] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:41.988539 3480 raft_consensus.cc:729] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 350dcc19d22b41ab89d1d0135672d71d, State: Initialized, Role: FOLLOWER
I20260808 05:54:41.989087 3480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350dcc19d22b41ab89d1d0135672d71d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38669 } }
I20260808 05:54:41.989223 3480 raft_consensus.cc:388] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:54:41.989310 3480 raft_consensus.cc:482] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:54:41.989416 3480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:41.990584 3480 raft_consensus.cc:504] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350dcc19d22b41ab89d1d0135672d71d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38669 } }
I20260808 05:54:41.990962 3480 leader_election.cc:302] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 350dcc19d22b41ab89d1d0135672d71d; no voters:
I20260808 05:54:41.991366 3480 leader_election.cc:288] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:54:41.991477 3485 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:41.991668 3485 raft_consensus.cc:686] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [term 1 LEADER]: Becoming Leader. State: Replica: 350dcc19d22b41ab89d1d0135672d71d, State: Running, Role: LEADER
I20260808 05:54:41.992005 3485 consensus_queue.cc:237] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350dcc19d22b41ab89d1d0135672d71d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38669 } }
I20260808 05:54:41.992357 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:41.977245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36924 (local address 127.2.191.126:38669)
0808 05:54:41.977696 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:41.977711 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:41.977747 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:54:41.978429 (+ 682us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:41.978448 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:41.978829 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:41.979167 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:41.980006 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:41.981138 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:41.982146 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:41.982823 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:41.983133 (+ 310us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:41.985793 (+ 2660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:41.985799 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:41.985816 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:41.985848 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:41.988823 (+ 2975us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:41.989404 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:41.989410 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:41.989423 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:41.989595 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:41.989881 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:41.989884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:41.989886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:41.990438 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:41.990649 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:41.990925 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 05:54:41.991269 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":141,"threads_started":1}
I20260808 05:54:41.992779 3480 sys_catalog.cc:564] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:54:41.993242 3485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 350dcc19d22b41ab89d1d0135672d71d. Latest consensus state: current_term: 1 leader_uuid: "350dcc19d22b41ab89d1d0135672d71d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350dcc19d22b41ab89d1d0135672d71d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38669 } } }
I20260808 05:54:41.993361 3485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:41.993772 3486 sys_catalog.cc:455] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "350dcc19d22b41ab89d1d0135672d71d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "350dcc19d22b41ab89d1d0135672d71d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38669 } } }
I20260808 05:54:41.993957 3486 sys_catalog.cc:458] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d [sys.catalog]: This master's current role is: LEADER
W20260808 05:54:41.997862 3500 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:54:41.997946 3500 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:54:41.998005 3489 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:54:41.998862 3489 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:54:42.004458 3489 catalog_manager.cc:1347] Generated new cluster ID: d9dd6a90f16b4e5db625956cba945c67
I20260808 05:54:42.004552 3489 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:54:42.026350 3489 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:54:42.027510 3489 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:54:42.035102 3489 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 350dcc19d22b41ab89d1d0135672d71d: Generated new TSK 0
I20260808 05:54:42.035892 3489 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:54:42.072311 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38669
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:46133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:42.189769 3506 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:42.190025 3506 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:42.190068 3506 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:42.194247 3506 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:42.194303 3506 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:42.194401 3506 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:54:42.199885 3506 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:46133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38669
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3506
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:42.201006 3506 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:42.202031 3506 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:42.211762 3511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:42.211762 3515 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:42.211855 3506 server_base.cc:1034] running on GCE node
W20260808 05:54:42.211758 3512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:42.213213 3506 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:42.213842 3506 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:42.215018 3506 hybrid_clock.cc:648] HybridClock initialized: now 1786168482214978 us; error 57 us; skew 500 ppm
Aug 08 05:54:42 dist-test-slave-qg60 krb5kdc[3389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168482, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:42.218143 3506 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:54:42.219120 3506 webserver.cc:460] Webserver started at http://127.2.191.65:38111/ using document root <none> and password file <none>
I20260808 05:54:42.219738 3506 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:42.219837 3506 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:42.220085 3506 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:42.222266 3506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "18f30cf09afd6d2bc5d8f7ef5aedf171"
server_key_iv: "f3c62bb4369a0ac4bed0a3408b2cf4af"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.222903 3506 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "18f30cf09afd6d2bc5d8f7ef5aedf171"
server_key_iv: "f3c62bb4369a0ac4bed0a3408b2cf4af"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.227051 3506 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:54:42.229663 3522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.230952 3506 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:54:42.231105 3506 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "18f30cf09afd6d2bc5d8f7ef5aedf171"
server_key_iv: "f3c62bb4369a0ac4bed0a3408b2cf4af"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.231227 3506 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:42.250082 3506 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:42.253165 3506 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:42.253374 3506 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:42.253988 3506 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:42.254830 3506 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:42.254905 3506 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.254977 3506 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:42.255031 3506 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.264698 3506 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:37823
I20260808 05:54:42.264747 3646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:37823 every 8 connection(s)
I20260808 05:54:42.265702 3506 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:54:42.269879 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 3506
I20260808 05:54:42.270079 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:54:42.270406 2813 external_mini_cluster.cc:1428] Setting key 32d926dab0d74701eff2ddc570c7db5b
Aug 08 05:54:42 dist-test-slave-qg60 krb5kdc[3389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168482, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:54:42.281046 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.267719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:41357 (local address 127.2.191.126:38669)
0808 05:54:42.267879 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.267884 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.268862 (+ 978us) server_negotiation.cc:407] Connection header received
0808 05:54:42.270304 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.270308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.270368 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.270469 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:42.271799 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.272606 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.273955 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.274206 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.274291 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.277297 (+ 3006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:42.277306 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:42.277308 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:42.277333 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:42.278869 (+ 1536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:42.279422 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:42.279431 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:42.279432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:42.279513 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:42.279874 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:42.279877 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:42.279879 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:42.280076 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:42.280188 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.280695 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.280850 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 05:54:42.281888 3649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.268153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38669 (local address 127.2.191.65:41357)
0808 05:54:42.268650 (+ 497us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:42.268695 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:42.270017 (+ 1322us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:42.270651 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:42.270658 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:42.271130 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:42.271627 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.271641 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.272801 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.272804 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.273782 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.273797 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.274370 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.274377 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.274644 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.275290 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:42.275317 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:42.277114 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:42.279015 (+ 1901us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:42.279020 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:42.279036 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:42.279306 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:42.279608 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:42.279613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:42.279615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:42.279764 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:42.280188 (+ 424us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:42.280196 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:42.280449 (+ 253us) client_negotiation.cc:769] Sending connection context
0808 05:54:42.280635 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 05:54:42.280995 (+ 360us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":150,"threads_started":1}
I20260808 05:54:42.283327 3647 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38669
I20260808 05:54:42.283598 3647 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:54:42.284240 3647 heartbeater.cc:511] Master 127.2.191.126:38669 requested a full tablet report, sending...
I20260808 05:54:42.286048 3438 ts_manager.cc:194] Registered new tserver with Master: ebe2a3f1a70d4d06bcdfae4ff9f54e15 (127.2.191.65:37823)
I20260808 05:54:42.287163 3438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:41357
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:54:42.300920 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38669
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:46133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:42.414227 3652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:42.414486 3652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:42.414531 3652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:42.418550 3652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:42.418608 3652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:42.418668 3652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:54:42.424360 3652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:46133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38669
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:42.425532 3652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:42.426548 3652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:42.436849 3662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:42.436851 3659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:42.436892 3658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:42.437268 3652 server_base.cc:1034] running on GCE node
I20260808 05:54:42.437740 3652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:42.438530 3652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:42.439771 3652 hybrid_clock.cc:648] HybridClock initialized: now 1786168482439755 us; error 36 us; skew 500 ppm
Aug 08 05:54:42 dist-test-slave-qg60 krb5kdc[3389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168482, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:42.442811 3652 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:54:42.443756 3652 webserver.cc:460] Webserver started at http://127.2.191.66:34171/ using document root <none> and password file <none>
I20260808 05:54:42.444320 3652 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:42.444384 3652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:42.444571 3652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:42.446877 3652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "2ed7c1cfedca467ebf03e420e0c300bd"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "1bb7c0b211dacaf0103657af113ce719"
server_key_iv: "91cd334e7cede4dc97c25394ce404ac4"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.447542 3652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "2ed7c1cfedca467ebf03e420e0c300bd"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "1bb7c0b211dacaf0103657af113ce719"
server_key_iv: "91cd334e7cede4dc97c25394ce404ac4"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.456472 3652 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.003s sys 0.004s
I20260808 05:54:42.459497 3669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.460971 3652 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:54:42.461187 3652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "2ed7c1cfedca467ebf03e420e0c300bd"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "1bb7c0b211dacaf0103657af113ce719"
server_key_iv: "91cd334e7cede4dc97c25394ce404ac4"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.461328 3652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:42.494169 3652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:42.497979 3652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:42.498234 3652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:42.499040 3652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:42.500259 3652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:42.500324 3652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.500388 3652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:42.500427 3652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.512180 3652 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:35031
I20260808 05:54:42.512202 3800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:35031 every 8 connection(s)
I20260808 05:54:42.513180 3652 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:54:42.518239 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 3652
I20260808 05:54:42.518352 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:54:42.518605 2813 external_mini_cluster.cc:1428] Setting key 319dea983bf0e0da3a1c7d853b16cd33
Aug 08 05:54:42 dist-test-slave-qg60 krb5kdc[3389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168482, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:42.527835 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.515166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:36807 (local address 127.2.191.126:38669)
0808 05:54:42.515319 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.515323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.516212 (+ 889us) server_negotiation.cc:407] Connection header received
0808 05:54:42.517708 (+ 1496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.517712 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.517765 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.517845 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:42.519302 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.519860 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.521101 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.521330 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.521445 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.523981 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:42.523985 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:42.523987 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:42.524010 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:42.525659 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:42.526243 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:42.526246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:42.526248 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:42.526334 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:42.526688 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:42.526692 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:42.526694 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:42.526888 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:42.526998 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.527513 (+ 515us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.527660 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:54:42.528671 3803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.515519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38669 (local address 127.2.191.66:36807)
0808 05:54:42.516008 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:42.516092 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:42.517461 (+ 1369us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:42.518030 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:42.518060 (+ 30us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:42.518522 (+ 462us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:42.519147 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.519173 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.520011 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.520013 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.520968 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.520977 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.521484 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.521488 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.521656 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.522301 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:42.522317 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:42.523804 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:42.525791 (+ 1987us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:42.525797 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:42.525813 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:42.526129 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:42.526431 (+ 302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:42.526436 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:42.526438 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:42.526590 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:42.527009 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:42.527017 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:42.527273 (+ 256us) client_negotiation.cc:769] Sending connection context
0808 05:54:42.527470 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 05:54:42.527801 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":124,"threads_started":1}
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:54:42.529956 3801 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38669
I20260808 05:54:42.530210 3801 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:42.530776 3801 heartbeater.cc:511] Master 127.2.191.126:38669 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:54:42.531888 3438 ts_manager.cc:194] Registered new tserver with Master: 2ed7c1cfedca467ebf03e420e0c300bd (127.2.191.66:35031)
I20260808 05:54:42.532828 3438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:36807
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:54:42.549412 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38669
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:46133
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:42.670804 3808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:42.671064 3808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:42.671109 3808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:42.675024 3808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:42.675084 3808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:42.675143 3808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:54:42.680473 3808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:46133
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38669
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:42.681586 3808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:42.682600 3808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:42.692955 3816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:42.693104 3814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:42.693100 3808 server_base.cc:1034] running on GCE node
W20260808 05:54:42.692943 3818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:42.693652 3808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:42.694329 3808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:42.695537 3808 hybrid_clock.cc:648] HybridClock initialized: now 1786168482695517 us; error 30 us; skew 500 ppm
Aug 08 05:54:42 dist-test-slave-qg60 krb5kdc[3389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168482, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:42.698654 3808 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:54:42.699510 3808 webserver.cc:460] Webserver started at http://127.2.191.67:35597/ using document root <none> and password file <none>
I20260808 05:54:42.700055 3808 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:42.700119 3808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:42.700290 3808 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:42.702380 3808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "0c96571acb054d7fb9a559b31c4a4c19"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "647e8f9c694b14e9bc591f2c4702f8fc"
server_key_iv: "05cde7964692ec4f8d77242211ba2e65"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.702922 3808 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "0c96571acb054d7fb9a559b31c4a4c19"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "647e8f9c694b14e9bc591f2c4702f8fc"
server_key_iv: "05cde7964692ec4f8d77242211ba2e65"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.706919 3808 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:54:42.709571 3825 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.710880 3808 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:54:42.710994 3808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "0c96571acb054d7fb9a559b31c4a4c19"
format_stamp: "Formatted at 2026-08-08 05:54:42 on dist-test-slave-qg60"
server_key: "647e8f9c694b14e9bc591f2c4702f8fc"
server_key_iv: "05cde7964692ec4f8d77242211ba2e65"
server_key_version: "encryptionkey@0"
I20260808 05:54:42.711095 3808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:42.723733 3808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:42.727424 3808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:42.727612 3808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:42.728204 3808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:42.729239 3808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:42.729318 3808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.729379 3808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:42.729404 3808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:42.739959 3808 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:41129
I20260808 05:54:42.739982 3948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:41129 every 8 connection(s)
I20260808 05:54:42.741110 3808 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:54:42.747720 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 3808
I20260808 05:54:42.747869 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:54:42.748229 2813 external_mini_cluster.cc:1428] Setting key 4e54a5b643613ec3967335066d28d2d6
Aug 08 05:54:42 dist-test-slave-qg60 krb5kdc[3389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168482, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:42.757871 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.743307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:57003 (local address 127.2.191.126:38669)
0808 05:54:42.743492 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.743496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.744758 (+ 1262us) server_negotiation.cc:407] Connection header received
0808 05:54:42.746808 (+ 2050us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.746813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.746877 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.746985 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:42.748650 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.749496 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.751087 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.751332 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.751424 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.754139 (+ 2715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:42.754142 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:42.754145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:42.754172 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:42.755863 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:42.756391 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:42.756394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:42.756396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:42.756483 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:42.756860 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:42.756862 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:42.756863 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:42.757066 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:42.757149 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.757634 (+ 485us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.757747 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 05:54:42.758739 3952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.743865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38669 (local address 127.2.191.67:57003)
0808 05:54:42.744532 (+ 667us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:42.744599 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:42.746511 (+ 1912us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:42.747203 (+ 692us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:42.747212 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:42.747750 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:42.748427 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.748460 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.749698 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.749703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.750971 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.750981 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.751468 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.751471 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.751630 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.752282 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:42.752299 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:42.753961 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:42.755980 (+ 2019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:42.755985 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:42.755998 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:42.756268 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:42.756589 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:42.756591 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:42.756593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:42.756776 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:42.757160 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:42.757165 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:42.757398 (+ 233us) client_negotiation.cc:769] Sending connection context
0808 05:54:42.757571 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 05:54:42.757832 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":175,"threads_started":1}
I20260808 05:54:42.760190 3949 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38669
I20260808 05:54:42.760548 3949 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:42.761183 3949 heartbeater.cc:511] Master 127.2.191.126:38669 requested a full tablet report, sending...
I20260808 05:54:42.762331 3438 ts_manager.cc:194] Registered new tserver with Master: 0c96571acb054d7fb9a559b31c4a4c19 (127.2.191.67:41129)
I20260808 05:54:42.763038 3438 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:57003
I20260808 05:54:42.774878 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:54:42.786760 3483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.779121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36930 (local address 127.2.191.126:38669)
0808 05:54:42.779266 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.779270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.779407 (+ 137us) server_negotiation.cc:407] Connection header received
0808 05:54:42.779542 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.779544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.779597 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.779666 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:42.780384 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.781059 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.781865 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.782131 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.782216 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.783516 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:42.783519 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:42.783521 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:42.783546 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:42.785131 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:42.785510 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:42.785513 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:42.785514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:42.785588 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:42.785897 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:42.785899 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:42.785900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:42.786162 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:42.786270 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.786501 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.786637 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:54:42.791864 3438 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36930:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:54:42.795256 3438 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:42.811023 3966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.804375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48148 (local address 127.2.191.67:41129)
0808 05:54:42.804857 (+ 482us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.804872 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.805762 (+ 890us) server_negotiation.cc:407] Connection header received
0808 05:54:42.805999 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.806005 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.806209 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.806354 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:42.806783 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.807527 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.809606 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.810186 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.810321 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.810517 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.810741 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.810850 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":129,"threads_started":1}
I20260808 05:54:42.811012 3963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.804249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41129 (local address 127.0.0.1:48148)
0808 05:54:42.805656 (+ 1407us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:42.805670 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:42.805838 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:42.806558 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:42.806563 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:42.806581 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:42.806673 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.806677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.807672 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.807677 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.809474 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.809482 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.810323 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.810326 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.810502 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.810563 (+ 61us) client_negotiation.cc:769] Sending connection context
0808 05:54:42.810704 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 05:54:42.810842 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1332,"mutex_wait_us":52,"thread_start_us":88,"threads_started":1}
I20260808 05:54:42.811427 3969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.805025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52816 (local address 127.2.191.66:35031)
0808 05:54:42.805453 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.805485 (+ 32us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.805868 (+ 383us) server_negotiation.cc:407] Connection header received
0808 05:54:42.805958 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.805963 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.806163 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.806325 (+ 162us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:42.806586 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.807781 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.809277 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.810272 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.810383 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.810521 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.811107 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.811202 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":168,"threads_started":1}
I20260808 05:54:42.811410 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.805044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59694 (local address 127.2.191.65:37823)
0808 05:54:42.805313 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.805322 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.805352 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:54:42.805603 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.805610 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.805835 (+ 225us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.806473 (+ 638us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:42.806666 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.807788 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.809474 (+ 1686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.810276 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.810383 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.810521 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.811107 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.811203 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":92,"threads_started":1}
I20260808 05:54:42.811779 3967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.804240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:37823 (local address 127.0.0.1:59694)
0808 05:54:42.805217 (+ 977us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:42.805270 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:42.805402 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:42.806011 (+ 609us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:42.806017 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:42.806039 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:42.806316 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.806326 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.807927 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.807930 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.809326 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.809337 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.810591 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.810594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.810812 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.810872 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 05:54:42.810946 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:54:42.811022 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":795,"mutex_wait_us":149,"thread_start_us":108,"threads_started":1}
I20260808 05:54:42.811488 3962 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.804490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:35031 (local address 127.0.0.1:52816)
0808 05:54:42.805686 (+ 1196us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:42.805699 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:42.805777 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:42.806315 (+ 538us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:42.806318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:42.806336 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:42.806461 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.806469 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.807958 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.807961 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.809152 (+ 1191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.809162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.810591 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.810594 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.810824 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.810874 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 05:54:42.810946 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 05:54:42.811022 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1135,"mutex_wait_us":24,"thread_start_us":106,"threads_started":1}
I20260808 05:54:42.814469 3877 tablet_service.cc:1467] Processing CreateTablet for tablet 423a010ea80941878c9831e1ae007712 (DEFAULT_TABLE table=test-table [id=075def014bed49d3ba6a3b14c5e4a06b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:42.814775 3573 tablet_service.cc:1467] Processing CreateTablet for tablet 423a010ea80941878c9831e1ae007712 (DEFAULT_TABLE table=test-table [id=075def014bed49d3ba6a3b14c5e4a06b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:42.814811 3726 tablet_service.cc:1467] Processing CreateTablet for tablet 423a010ea80941878c9831e1ae007712 (DEFAULT_TABLE table=test-table [id=075def014bed49d3ba6a3b14c5e4a06b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:42.815758 3877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 423a010ea80941878c9831e1ae007712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:42.815848 3726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 423a010ea80941878c9831e1ae007712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:42.815850 3573 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 423a010ea80941878c9831e1ae007712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:42.822785 3970 tablet_bootstrap.cc:492] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19: Bootstrap starting.
I20260808 05:54:42.824671 3971 tablet_bootstrap.cc:492] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15: Bootstrap starting.
I20260808 05:54:42.824990 3972 tablet_bootstrap.cc:492] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd: Bootstrap starting.
I20260808 05:54:42.826498 3970 tablet_bootstrap.cc:654] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:42.826709 3971 tablet_bootstrap.cc:654] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:42.827513 3971 log.cc:824] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:42.827534 3970 log.cc:824] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:42.827857 3972 tablet_bootstrap.cc:654] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:42.828960 3972 log.cc:824] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:42.830108 3971 tablet_bootstrap.cc:492] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15: No bootstrap required, opened a new log
I20260808 05:54:42.830173 3970 tablet_bootstrap.cc:492] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19: No bootstrap required, opened a new log
I20260808 05:54:42.830327 3971 ts_tablet_manager.cc:1397] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:54:42.830363 3970 ts_tablet_manager.cc:1397] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260808 05:54:42.831023 3972 tablet_bootstrap.cc:492] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd: No bootstrap required, opened a new log
I20260808 05:54:42.831212 3972 ts_tablet_manager.cc:1397] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 05:54:42.834743 3970 raft_consensus.cc:348] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.834743 3971 raft_consensus.cc:348] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.835083 3971 raft_consensus.cc:374] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:42.835104 3970 raft_consensus.cc:374] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:42.835150 3971 raft_consensus.cc:729] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ebe2a3f1a70d4d06bcdfae4ff9f54e15, State: Initialized, Role: FOLLOWER
I20260808 05:54:42.835163 3970 raft_consensus.cc:729] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c96571acb054d7fb9a559b31c4a4c19, State: Initialized, Role: FOLLOWER
I20260808 05:54:42.835654 3970 consensus_queue.cc:260] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.835582 3972 raft_consensus.cc:348] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.835700 3971 consensus_queue.cc:260] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.835821 3972 raft_consensus.cc:374] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:42.835870 3972 raft_consensus.cc:729] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ed7c1cfedca467ebf03e420e0c300bd, State: Initialized, Role: FOLLOWER
I20260808 05:54:42.836329 3972 consensus_queue.cc:260] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.836688 3970 ts_tablet_manager.cc:1428] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 05:54:42.836694 3971 ts_tablet_manager.cc:1428] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 05:54:42.837080 3949 heartbeater.cc:503] Master 127.2.191.126:38669 was elected leader, sending a full tablet report...
I20260808 05:54:42.837081 3801 heartbeater.cc:503] Master 127.2.191.126:38669 was elected leader, sending a full tablet report...
I20260808 05:54:42.837144 3647 heartbeater.cc:503] Master 127.2.191.126:38669 was elected leader, sending a full tablet report...
I20260808 05:54:42.837247 3972 ts_tablet_manager.cc:1428] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260808 05:54:42.952889 3978 raft_consensus.cc:482] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:42.953188 3978 raft_consensus.cc:504] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.954712 3978 leader_election.cc:288] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c96571acb054d7fb9a559b31c4a4c19 (127.2.191.67:41129), ebe2a3f1a70d4d06bcdfae4ff9f54e15 (127.2.191.65:37823)
I20260808 05:54:42.959043 3803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.955021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41129 (local address 127.2.191.66:54489)
0808 05:54:42.955188 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:42.955205 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:42.955310 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:42.955582 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:42.955585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:42.955602 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:42.955751 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.955758 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.956506 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.956511 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.957530 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.957540 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.958546 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.958550 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.958683 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.958704 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 05:54:42.958817 (+ 113us) client_negotiation.cc:240] Negotiation successful
0808 05:54:42.958894 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":21}
I20260808 05:54:42.959085 3966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.955116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:54489 (local address 127.2.191.67:41129)
0808 05:54:42.955338 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.955344 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.955363 (+ 19us) server_negotiation.cc:407] Connection header received
0808 05:54:42.955432 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.955434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.955472 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.955571 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:42.955881 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.956385 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.957676 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.958407 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.958558 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.958618 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.958853 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.958939 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260808 05:54:42.959829 3897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "423a010ea80941878c9831e1ae007712" candidate_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c96571acb054d7fb9a559b31c4a4c19" is_pre_election: true
I20260808 05:54:42.960278 3979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.955021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:37823 (local address 127.2.191.66:36409)
0808 05:54:42.955586 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:42.955600 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:42.955754 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:42.956061 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:42.956064 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:42.956081 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:42.956245 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.956252 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.957111 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.957118 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.958713 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:42.958729 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.959808 (+ 1079us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.959812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:42.959916 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.959945 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 05:54:42.960049 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 05:54:42.960118 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":497,"mutex_wait_us":184,"thread_start_us":183,"threads_started":1}
I20260808 05:54:42.960294 3897 raft_consensus.cc:2454] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ed7c1cfedca467ebf03e420e0c300bd in term 0.
I20260808 05:54:42.960326 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.955176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:36409 (local address 127.2.191.65:37823)
0808 05:54:42.955354 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.955362 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.955707 (+ 345us) server_negotiation.cc:407] Connection header received
0808 05:54:42.955888 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.955893 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.955950 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.956049 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:42.956380 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.956963 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.958903 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.959640 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.959747 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:42.959787 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:42.960122 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 05:54:42.960227 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:54:42.960950 3672 leader_election.cc:302] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c96571acb054d7fb9a559b31c4a4c19, 2ed7c1cfedca467ebf03e420e0c300bd; no voters:
I20260808 05:54:42.961124 3594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "423a010ea80941878c9831e1ae007712" candidate_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" is_pre_election: true
I20260808 05:54:42.961293 3978 raft_consensus.cc:2781] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:42.961422 3978 raft_consensus.cc:482] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:42.961416 3594 raft_consensus.cc:2454] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ed7c1cfedca467ebf03e420e0c300bd in term 0.
I20260808 05:54:42.961485 3978 raft_consensus.cc:3037] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:42.962865 3978 raft_consensus.cc:504] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.963228 3978 leader_election.cc:288] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [CANDIDATE]: Term 1 election: Requested vote from peers 0c96571acb054d7fb9a559b31c4a4c19 (127.2.191.67:41129), ebe2a3f1a70d4d06bcdfae4ff9f54e15 (127.2.191.65:37823)
I20260808 05:54:42.963768 3594 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "423a010ea80941878c9831e1ae007712" candidate_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15"
I20260808 05:54:42.963922 3594 raft_consensus.cc:3037] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:42.964854 3897 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "423a010ea80941878c9831e1ae007712" candidate_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c96571acb054d7fb9a559b31c4a4c19"
I20260808 05:54:42.964967 3897 raft_consensus.cc:3037] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:42.965312 3594 raft_consensus.cc:2454] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ed7c1cfedca467ebf03e420e0c300bd in term 1.
I20260808 05:54:42.965667 3673 leader_election.cc:302] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ed7c1cfedca467ebf03e420e0c300bd, ebe2a3f1a70d4d06bcdfae4ff9f54e15; no voters:
I20260808 05:54:42.965862 3978 raft_consensus.cc:2781] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:42.966099 3978 raft_consensus.cc:686] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [term 1 LEADER]: Becoming Leader. State: Replica: 2ed7c1cfedca467ebf03e420e0c300bd, State: Running, Role: LEADER
I20260808 05:54:42.966428 3978 consensus_queue.cc:237] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } }
I20260808 05:54:42.966602 3897 raft_consensus.cc:2454] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ed7c1cfedca467ebf03e420e0c300bd in term 1.
I20260808 05:54:42.970304 3437 catalog_manager.cc:5495] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ed7c1cfedca467ebf03e420e0c300bd (127.2.191.66). New cstate: current_term: 1 leader_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c96571acb054d7fb9a559b31c4a4c19" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ebe2a3f1a70d4d06bcdfae4ff9f54e15" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 37823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ed7c1cfedca467ebf03e420e0c300bd" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35031 } health_report { overall_health: HEALTHY } } }
W20260808 05:54:42.992219 3951 tablet.cc:2369] T 423a010ea80941878c9831e1ae007712 P 0c96571acb054d7fb9a559b31c4a4c19: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 05:54:42 dist-test-slave-qg60 krb5kdc[3389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168481, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:54:43.006027 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:42.996641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59696 (local address 127.2.191.65:37823)
0808 05:54:42.996957 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:42.996960 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:42.996976 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:54:42.997130 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:42.997132 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:42.997178 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:42.997250 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:42.997973 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.998502 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.999355 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:42.999575 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:42.999660 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:43.002298 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:43.002311 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:43.002327 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:43.002354 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:43.004226 (+ 1872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:43.004670 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:43.004676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:43.004678 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:43.004822 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:43.005074 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:43.005076 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:43.005077 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:43.005369 (+ 292us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:43.005541 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:43.005703 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 05:54:43.005802 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203}
W20260808 05:54:43.014338 3802 tablet.cc:2369] T 423a010ea80941878c9831e1ae007712 P 2ed7c1cfedca467ebf03e420e0c300bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:54:43.017350 3648 tablet.cc:2369] T 423a010ea80941878c9831e1ae007712 P ebe2a3f1a70d4d06bcdfae4ff9f54e15: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 05:54:43 dist-test-slave-qg60 krb5kdc[3389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168483, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:54:43 dist-test-slave-qg60 krb5kdc[3389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168483, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:54:43.037106 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:43.027244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59712 (local address 127.2.191.65:37823)
0808 05:54:43.027457 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:43.027463 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:43.027632 (+ 169us) server_negotiation.cc:407] Connection header received
0808 05:54:43.027835 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:43.027838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:43.027886 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:43.027986 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:43.028789 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:43.029454 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:43.030387 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:43.030647 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:43.030767 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:43.033668 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:43.033671 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:43.033674 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:43.033698 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:43.035303 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:43.035821 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:43.035824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:43.035826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:43.035917 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:43.036214 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:43.036216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:43.036217 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:43.036382 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:43.036483 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:43.036843 (+ 360us) server_negotiation.cc:299] Negotiation successful
0808 05:54:43.036951 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
Aug 08 05:54:43 dist-test-slave-qg60 krb5kdc[3389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:54:43 dist-test-slave-qg60 krb5kdc[3389](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:54:43.067673 3968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:43.057781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59716 (local address 127.2.191.65:37823)
0808 05:54:43.057983 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:43.057987 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:43.058147 (+ 160us) server_negotiation.cc:407] Connection header received
0808 05:54:43.058322 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:43.058326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:43.058380 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:43.058470 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:43.059242 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:43.059811 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:43.060886 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:43.061196 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:43.061291 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:43.063961 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:43.063964 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:43.063966 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:43.063991 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:43.065747 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:43.066188 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:43.066191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:43.066193 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:43.066276 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:43.066608 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:43.066611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:43.066612 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:43.066798 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:43.066909 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:43.067277 (+ 368us) server_negotiation.cc:299] Negotiation successful
0808 05:54:43.067445 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
W20260808 05:54:43.069643 3552 tablet_service.cc:2908] Rejecting scan request for tablet 423a010ea80941878c9831e1ae007712: Uninitialized: clean time has not yet been initialized
I20260808 05:54:43.072180 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 3506
I20260808 05:54:43.081015 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 3652
I20260808 05:54:43.089190 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 3808
I20260808 05:54:43.100421 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 3403
2026-08-08T05:54:43Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2617 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:54:43 dist-test-slave-qg60 krb5kdc[3995](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:54:43 dist-test-slave-qg60 krb5kdc[3995](info): set up 2 sockets
Aug 08 05:54:43 dist-test-slave-qg60 krb5kdc[3995](info): commencing operation
krb5kdc: starting...
W20260808 05:54:44.217013 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:54:44 dist-test-slave-qg60 krb5kdc[3995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:54:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:54:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:54:44.352952 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:39685
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:39685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:44.470250 4010 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:44.470577 4010 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:44.470661 4010 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:44.474656 4010 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:54:44.474748 4010 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:54:44.474782 4010 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:44.474824 4010 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:44.474858 4010 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:54:44.474910 4010 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:54:44.480201 4010 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:39685
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:39685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4010
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:44.481328 4010 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:44.482352 4010 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:44.490878 4015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:44.490918 4018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:44.490986 4016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:44.491044 4010 server_base.cc:1034] running on GCE node
I20260808 05:54:44.491844 4010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:44.493031 4010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:44.494197 4010 hybrid_clock.cc:648] HybridClock initialized: now 1786168484494171 us; error 40 us; skew 500 ppm
Aug 08 05:54:44 dist-test-slave-qg60 krb5kdc[3995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168484, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:44.501834 4010 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:54:44.502813 4010 webserver.cc:460] Webserver started at http://127.2.191.126:37773/ using document root <none> and password file <none>
I20260808 05:54:44.503364 4010 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:44.503424 4010 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:44.503599 4010 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:44.505770 4010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "c82fa1492da340e498dcea6ef101d92b"
format_stamp: "Formatted at 2026-08-08 05:54:44 on dist-test-slave-qg60"
server_key: "502d0707540e2eb758576ca9813d1dff"
server_key_iv: "c4509922c472d5c3fb5d8702b50f07a4"
server_key_version: "encryptionkey@0"
I20260808 05:54:44.506301 4010 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "c82fa1492da340e498dcea6ef101d92b"
format_stamp: "Formatted at 2026-08-08 05:54:44 on dist-test-slave-qg60"
server_key: "502d0707540e2eb758576ca9813d1dff"
server_key_iv: "c4509922c472d5c3fb5d8702b50f07a4"
server_key_version: "encryptionkey@0"
I20260808 05:54:44.510213 4010 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:54:44.512569 4025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:44.513854 4010 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:54:44.513988 4010 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "c82fa1492da340e498dcea6ef101d92b"
format_stamp: "Formatted at 2026-08-08 05:54:44 on dist-test-slave-qg60"
server_key: "502d0707540e2eb758576ca9813d1dff"
server_key_iv: "c4509922c472d5c3fb5d8702b50f07a4"
server_key_version: "encryptionkey@0"
I20260808 05:54:44.514127 4010 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:44.524796 4010 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:44.528043 4010 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:44.528270 4010 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:44.537415 4010 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:39685
I20260808 05:54:44.537432 4093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:39685 every 8 connection(s)
I20260808 05:54:44.538446 4010 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:54:44.540417 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 4010
I20260808 05:54:44.540539 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:54:44.540884 2813 external_mini_cluster.cc:1428] Setting key 7a072d2d7e24049d727d4683ab1737d5
I20260808 05:54:44.541688 4094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:44.549008 4094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b: Bootstrap starting.
Aug 08 05:54:44 dist-test-slave-qg60 krb5kdc[3995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:44.551553 4094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:44.553202 4094 log.cc:824] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:44.556067 4094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b: No bootstrap required, opened a new log
I20260808 05:54:44.557309 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:44.542522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39598 (local address 127.2.191.126:39685)
0808 05:54:44.542960 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:44.542978 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:44.543022 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:54:44.543874 (+ 852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:44.543896 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:44.544317 (+ 421us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:44.544710 (+ 393us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:44.545500 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.547012 (+ 1512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.547916 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.548595 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.548790 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:44.551478 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:44.551486 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:44.551506 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:44.551554 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:44.553789 (+ 2235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:44.554461 (+ 672us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:44.554468 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:44.554475 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:44.554622 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:44.554945 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:44.554949 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:44.554950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:44.555477 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:44.555682 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:44.555945 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 05:54:44.556304 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":291,"thread_start_us":112,"threads_started":1}
I20260808 05:54:44.559870 4094 raft_consensus.cc:348] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c82fa1492da340e498dcea6ef101d92b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39685 } }
I20260808 05:54:44.560087 4094 raft_consensus.cc:374] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:44.560123 4094 raft_consensus.cc:729] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c82fa1492da340e498dcea6ef101d92b, State: Initialized, Role: FOLLOWER
I20260808 05:54:44.560479 4094 consensus_queue.cc:260] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c82fa1492da340e498dcea6ef101d92b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39685 } }
I20260808 05:54:44.560598 4094 raft_consensus.cc:388] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:54:44.560637 4094 raft_consensus.cc:482] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:54:44.560740 4094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:44.561847 4094 raft_consensus.cc:504] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c82fa1492da340e498dcea6ef101d92b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39685 } }
I20260808 05:54:44.562155 4094 leader_election.cc:302] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c82fa1492da340e498dcea6ef101d92b; no voters:
I20260808 05:54:44.562465 4094 leader_election.cc:288] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:54:44.562548 4100 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:44.562747 4100 raft_consensus.cc:686] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [term 1 LEADER]: Becoming Leader. State: Replica: c82fa1492da340e498dcea6ef101d92b, State: Running, Role: LEADER
I20260808 05:54:44.563050 4100 consensus_queue.cc:237] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c82fa1492da340e498dcea6ef101d92b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39685 } }
I20260808 05:54:44.563791 4094 sys_catalog.cc:564] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:54:44.564937 4101 sys_catalog.cc:455] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [sys.catalog]: SysCatalogTable state changed. Reason: New leader c82fa1492da340e498dcea6ef101d92b. Latest consensus state: current_term: 1 leader_uuid: "c82fa1492da340e498dcea6ef101d92b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c82fa1492da340e498dcea6ef101d92b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39685 } } }
I20260808 05:54:44.565127 4101 sys_catalog.cc:458] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:44.565392 4102 sys_catalog.cc:455] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c82fa1492da340e498dcea6ef101d92b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c82fa1492da340e498dcea6ef101d92b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39685 } } }
I20260808 05:54:44.565495 4102 sys_catalog.cc:458] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:44.565653 4110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:54:44.569057 4110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:54:44.575068 4110 catalog_manager.cc:1347] Generated new cluster ID: b274cbcdfeae4e32abe4fa83038c8c43
I20260808 05:54:44.575155 4110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:54:44.593240 4110 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:54:44.594565 4110 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:54:44.603405 4110 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b: Generated new TSK 0
I20260808 05:54:44.604279 4110 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:54:44.635898 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39685
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:44.755959 4124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:44.756227 4124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:44.756273 4124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:44.760329 4124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:44.760392 4124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:44.760430 4124 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:54:44.760499 4124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:54:44.766268 4124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:39685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:44.767403 4124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:44.768486 4124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:44.778961 4132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:44.778967 4129 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:44.779336 4124 server_base.cc:1034] running on GCE node
W20260808 05:54:44.779088 4130 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:44.779785 4124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:44.780495 4124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:44.781723 4124 hybrid_clock.cc:648] HybridClock initialized: now 1786168484781692 us; error 48 us; skew 500 ppm
Aug 08 05:54:44 dist-test-slave-qg60 krb5kdc[3995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168484, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:44.784698 4124 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:54:44.785812 4124 webserver.cc:460] Webserver started at http://127.2.191.65:36533/ using document root <none> and password file <none>
I20260808 05:54:44.786406 4124 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:44.786504 4124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:44.786753 4124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:44.788897 4124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "0ce512a711024ef69070ecf68a9bb624"
format_stamp: "Formatted at 2026-08-08 05:54:44 on dist-test-slave-qg60"
server_key: "97ab6dad60b4f2120e81dedfd02b3e32"
server_key_iv: "2542063b36bc88d354601971b6f16ef1"
server_key_version: "encryptionkey@0"
I20260808 05:54:44.789510 4124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "0ce512a711024ef69070ecf68a9bb624"
format_stamp: "Formatted at 2026-08-08 05:54:44 on dist-test-slave-qg60"
server_key: "97ab6dad60b4f2120e81dedfd02b3e32"
server_key_iv: "2542063b36bc88d354601971b6f16ef1"
server_key_version: "encryptionkey@0"
I20260808 05:54:44.793426 4124 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:54:44.795871 4139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:44.797232 4124 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:54:44.797379 4124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "0ce512a711024ef69070ecf68a9bb624"
format_stamp: "Formatted at 2026-08-08 05:54:44 on dist-test-slave-qg60"
server_key: "97ab6dad60b4f2120e81dedfd02b3e32"
server_key_iv: "2542063b36bc88d354601971b6f16ef1"
server_key_version: "encryptionkey@0"
I20260808 05:54:44.797499 4124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:44.812316 4124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:44.815474 4124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:44.815687 4124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:44.817344 4124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:44.817414 4124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:44.817478 4124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:44.817508 4124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:54:44 dist-test-slave-qg60 krb5kdc[3995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168484, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:44.830338 4124 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:44497
I20260808 05:54:44.830657 4266 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:44497 every 8 connection(s)
I20260808 05:54:44.831526 4124 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:54:44.833527 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:44.818407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:41343 (local address 127.2.191.126:39685)
0808 05:54:44.818590 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:44.818595 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:44.819562 (+ 967us) server_negotiation.cc:407] Connection header received
0808 05:54:44.820769 (+ 1207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:44.820773 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:44.820844 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:44.820954 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:44.822565 (+ 1611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.823390 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.824927 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.825195 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.825323 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:44.829258 (+ 3935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:44.829262 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:44.829265 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:44.829302 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:44.831238 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:44.831852 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:44.831860 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:44.831864 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:44.831990 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:44.832422 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:44.832425 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:44.832427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:44.832657 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:44.832796 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:44.833265 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 05:54:44.833380 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 05:54:44.833587 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 4124
I20260808 05:54:44.833693 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:54:44.833989 2813 external_mini_cluster.cc:1428] Setting key bd8147874a9ed83824abf4f5fa011418
I20260808 05:54:44.834601 4149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:44.818877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39685 (local address 127.2.191.65:41343)
0808 05:54:44.819364 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:44.819430 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:44.820485 (+ 1055us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:44.821189 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:44.821202 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:44.821707 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:44.822372 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:44.822390 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.823558 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.823562 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:44.824782 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:44.824795 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.825366 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.825371 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:44.825590 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:44.826435 (+ 845us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:44.826455 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:44.829064 (+ 2609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:44.831367 (+ 2303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:44.831371 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:44.831383 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:44.831743 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:44.832117 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:44.832120 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:44.832122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:44.832311 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:44.832807 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:44.832813 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:44.833056 (+ 243us) client_negotiation.cc:769] Sending connection context
0808 05:54:44.833217 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 05:54:44.833584 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":140,"threads_started":1}
I20260808 05:54:44.835948 4267 heartbeater.cc:347] Connected to a master server at 127.2.191.126:39685
I20260808 05:54:44.836102 4267 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:44.836601 4267 heartbeater.cc:511] Master 127.2.191.126:39685 requested a full tablet report, sending...
I20260808 05:54:44.838308 4044 ts_manager.cc:194] Registered new tserver with Master: 0ce512a711024ef69070ecf68a9bb624 (127.2.191.65:44497)
I20260808 05:54:44.839985 4044 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:41343
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:54:44.848424 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:44.838467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:46621 (local address 127.2.191.126:39685)
0808 05:54:44.840762 (+ 2295us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:44.840769 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:44.840787 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:54:44.840831 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:44.840836 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:44.840890 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:44.840978 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:44.841582 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.842075 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.843266 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.843504 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.843599 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:44.845070 (+ 1471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:44.845074 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:44.845076 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:44.845100 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:44.846665 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:44.847150 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:44.847153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:44.847154 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:44.847229 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:44.847575 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:44.847579 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:44.847581 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:44.847762 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:44.847874 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:44.848142 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 05:54:44.848258 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2172}
I20260808 05:54:44.848433 4274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:44.838400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39685 (local address 127.2.191.65:46621)
0808 05:54:44.838674 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:44.838695 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:44.838784 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:44.841101 (+ 2317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:44.841104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:44.841326 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:44.841438 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:44.841446 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.842218 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.842222 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:44.843132 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:44.843147 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:44.843643 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:44.843649 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:44.843793 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:44.844356 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:44.844375 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:44.844914 (+ 539us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:44.846784 (+ 1870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:44.846790 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:44.846794 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:44.847044 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:44.847344 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:44.847348 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:44.847350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:44.847444 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:44.847864 (+ 420us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:44.847867 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:44.847968 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 05:54:44.848075 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 05:54:44.848229 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:54:44.868221 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39685
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:44.980296 4276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:44.980619 4276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:44.980703 4276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:44.984835 4276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:44.984920 4276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:44.984989 4276 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:54:44.985080 4276 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:54:44.990468 4276 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:39685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:44.991580 4276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:44.992626 4276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:45.003047 4283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:45.003115 4285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:45.003192 4276 server_base.cc:1034] running on GCE node
W20260808 05:54:45.003115 4281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:45.003679 4276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:45.004351 4276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:45.005527 4276 hybrid_clock.cc:648] HybridClock initialized: now 1786168485005493 us; error 56 us; skew 500 ppm
Aug 08 05:54:45 dist-test-slave-qg60 krb5kdc[3995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168485, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:45.008520 4276 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:54:45.009618 4276 webserver.cc:460] Webserver started at http://127.2.191.66:37639/ using document root <none> and password file <none>
I20260808 05:54:45.010181 4276 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:45.010244 4276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:45.010416 4276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:45.012499 4276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "563041b7ceaa46dca4be691d8a2e6af4"
format_stamp: "Formatted at 2026-08-08 05:54:45 on dist-test-slave-qg60"
server_key: "4fd2d73ea5643ef979ad16bc4c401959"
server_key_iv: "3ec1094bc4c4969c5a95fc1ee08de7dd"
server_key_version: "encryptionkey@0"
I20260808 05:54:45.013104 4276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "563041b7ceaa46dca4be691d8a2e6af4"
format_stamp: "Formatted at 2026-08-08 05:54:45 on dist-test-slave-qg60"
server_key: "4fd2d73ea5643ef979ad16bc4c401959"
server_key_iv: "3ec1094bc4c4969c5a95fc1ee08de7dd"
server_key_version: "encryptionkey@0"
I20260808 05:54:45.017189 4276 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:54:45.019827 4293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:45.021322 4276 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:54:45.021426 4276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "563041b7ceaa46dca4be691d8a2e6af4"
format_stamp: "Formatted at 2026-08-08 05:54:45 on dist-test-slave-qg60"
server_key: "4fd2d73ea5643ef979ad16bc4c401959"
server_key_iv: "3ec1094bc4c4969c5a95fc1ee08de7dd"
server_key_version: "encryptionkey@0"
I20260808 05:54:45.021581 4276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:45.038920 4276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:45.042068 4276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:45.042272 4276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:45.043737 4276 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:45.043789 4276 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:45.043860 4276 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:45.043895 4276 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:54:45 dist-test-slave-qg60 krb5kdc[3995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168485, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:45.055588 4276 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:37647
I20260808 05:54:45.055727 4420 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:37647 every 8 connection(s)
I20260808 05:54:45.056699 4276 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:54:45.059120 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.044858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:36871 (local address 127.2.191.126:39685)
0808 05:54:45.045068 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.045072 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.046120 (+ 1048us) server_negotiation.cc:407] Connection header received
0808 05:54:45.047412 (+ 1292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.047416 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.047484 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.047619 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:45.049376 (+ 1757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.050239 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.051585 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.051830 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.051953 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.054974 (+ 3021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:45.054977 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:45.054979 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:45.055007 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:45.056952 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.057632 (+ 680us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.057635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.057636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.057718 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.058017 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.058019 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.058020 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.058239 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:45.058318 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.058863 (+ 545us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.058973 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:54:45.060097 4303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.045346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39685 (local address 127.2.191.66:36871)
0808 05:54:45.045907 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.045969 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.047172 (+ 1203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.047856 (+ 684us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.047867 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.048351 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:45.049176 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.049202 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.050375 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.050378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.051453 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.051463 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.052018 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.052022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.052248 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.052901 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:45.052917 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:45.054740 (+ 1823us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:45.057080 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.057086 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.057103 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.057488 (+ 385us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.057789 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.057791 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.057793 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.057922 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.058369 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:45.058375 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:45.058624 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.058805 (+ 181us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.059112 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":148,"threads_started":1}
I20260808 05:54:45.061453 4421 heartbeater.cc:347] Connected to a master server at 127.2.191.126:39685
I20260808 05:54:45.061617 4421 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:45.062104 4421 heartbeater.cc:511] Master 127.2.191.126:39685 requested a full tablet report, sending...
I20260808 05:54:45.063201 4039 ts_manager.cc:194] Registered new tserver with Master: 563041b7ceaa46dca4be691d8a2e6af4 (127.2.191.66:37647)
I20260808 05:54:45.063956 4039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:36871
I20260808 05:54:45.065755 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 4276
I20260808 05:54:45.065884 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:54:45.066272 2813 external_mini_cluster.cc:1428] Setting key 65f8fd148f4e14d353873c96666a3373
I20260808 05:54:45.071971 4427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.063746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39685 (local address 127.2.191.66:44659)
0808 05:54:45.064218 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.064233 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.064371 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.064667 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.064669 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.064933 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:45.065043 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.065049 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.066092 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.066098 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.066845 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.066854 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.067339 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.067342 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.067436 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.068032 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:45.068052 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:45.068380 (+ 328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:45.070236 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.070239 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.070241 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.070448 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.070748 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.070753 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.070754 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.070844 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.071438 (+ 594us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:45.071441 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:45.071536 (+ 95us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.071656 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.071788 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":102,"threads_started":1}
I20260808 05:54:45.072111 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.063867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:44659 (local address 127.2.191.126:39685)
0808 05:54:45.064004 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.064017 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.064324 (+ 307us) server_negotiation.cc:407] Connection header received
0808 05:54:45.064482 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.064488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.064540 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.064628 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:45.065165 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.065947 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.066951 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.067213 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.067333 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.068523 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:45.068527 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:45.068530 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:45.068578 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:45.070112 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.070563 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.070566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.070568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.070652 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.070940 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.070944 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.070945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.071288 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:45.071418 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.071740 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.071882 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:54:45.096599 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39685
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44837
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:45.212965 4431 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:45.213212 4431 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:45.213253 4431 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:45.217121 4431 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:45.217170 4431 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:45.217207 4431 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:54:45.217239 4431 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:54:45.222553 4431 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44837
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:39685
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:45.223587 4431 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:45.224539 4431 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:45.234843 4436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:45.234843 4439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:45.234843 4437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:45.235070 4431 server_base.cc:1034] running on GCE node
I20260808 05:54:45.235634 4431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:45.236418 4431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:45.237633 4431 hybrid_clock.cc:648] HybridClock initialized: now 1786168485237606 us; error 44 us; skew 500 ppm
Aug 08 05:54:45 dist-test-slave-qg60 krb5kdc[3995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168485, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:45.240571 4431 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:54:45.241616 4431 webserver.cc:460] Webserver started at http://127.2.191.67:40747/ using document root <none> and password file <none>
I20260808 05:54:45.242205 4431 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:45.242300 4431 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:45.242542 4431 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:45.244640 4431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "e30b0dd5482a481eae29c01d17622203"
format_stamp: "Formatted at 2026-08-08 05:54:45 on dist-test-slave-qg60"
server_key: "71f4ed2ee1d01eaf77d4417078351ea9"
server_key_iv: "3b50a2880f33a3523dc586a9cf7ac6fc"
server_key_version: "encryptionkey@0"
I20260808 05:54:45.245272 4431 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "e30b0dd5482a481eae29c01d17622203"
format_stamp: "Formatted at 2026-08-08 05:54:45 on dist-test-slave-qg60"
server_key: "71f4ed2ee1d01eaf77d4417078351ea9"
server_key_iv: "3b50a2880f33a3523dc586a9cf7ac6fc"
server_key_version: "encryptionkey@0"
I20260808 05:54:45.249130 4431 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:54:45.251500 4449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:45.252718 4431 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:54:45.252918 4431 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "e30b0dd5482a481eae29c01d17622203"
format_stamp: "Formatted at 2026-08-08 05:54:45 on dist-test-slave-qg60"
server_key: "71f4ed2ee1d01eaf77d4417078351ea9"
server_key_iv: "3b50a2880f33a3523dc586a9cf7ac6fc"
server_key_version: "encryptionkey@0"
I20260808 05:54:45.253072 4431 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:45.285179 4431 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:45.288703 4431 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:45.288977 4431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:45.290520 4431 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:45.290594 4431 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:45.290666 4431 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:45.290714 4431 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:54:45 dist-test-slave-qg60 krb5kdc[3995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168485, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:45.301978 4431 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:34575
I20260808 05:54:45.302337 4580 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:34575 every 8 connection(s)
I20260808 05:54:45.303001 4431 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:54:45.304119 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 4431
I20260808 05:54:45.304250 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:54:45.304559 2813 external_mini_cluster.cc:1428] Setting key 5bdec704cbfa34855dfe6b5a521f3483
I20260808 05:54:45.305366 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.291458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:50909 (local address 127.2.191.126:39685)
0808 05:54:45.291660 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.291665 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.292493 (+ 828us) server_negotiation.cc:407] Connection header received
0808 05:54:45.293658 (+ 1165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.293664 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.293736 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.293800 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:45.295785 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.296695 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.298016 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.298265 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.298385 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.301257 (+ 2872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:45.301261 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:45.301263 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:45.301298 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:45.302988 (+ 1690us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.303519 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.303523 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.303525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.303628 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.304061 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.304064 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.304066 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.304308 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:45.304424 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.305060 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.305194 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 05:54:45.306114 4459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.291842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39685 (local address 127.2.191.67:50909)
0808 05:54:45.292313 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.292367 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.293382 (+ 1015us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.294354 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.294365 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.294808 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:45.295582 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.295603 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.296858 (+ 1255us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.296862 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.297861 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.297871 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.298450 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.298455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.298628 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.299287 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:45.299303 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:45.301075 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:45.303119 (+ 2044us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.303125 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.303139 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.303406 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.303737 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.303740 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.303742 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.303919 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.304433 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:45.304442 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:45.304778 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.304989 (+ 211us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.305311 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":137,"threads_started":1}
I20260808 05:54:45.307447 4581 heartbeater.cc:347] Connected to a master server at 127.2.191.126:39685
I20260808 05:54:45.307613 4581 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:45.308147 4581 heartbeater.cc:511] Master 127.2.191.126:39685 requested a full tablet report, sending...
I20260808 05:54:45.309250 4039 ts_manager.cc:194] Registered new tserver with Master: e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575)
I20260808 05:54:45.309976 4039 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:50909
I20260808 05:54:45.317337 4590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.309864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39685 (local address 127.2.191.67:46253)
0808 05:54:45.310205 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.310223 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.310320 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.310584 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.310587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.310804 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:45.310986 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.310994 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.311721 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.311724 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.312416 (+ 692us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.312425 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.312911 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.312914 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.313072 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.313539 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:45.313551 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:45.313862 (+ 311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:45.315658 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.315661 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.315662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.315869 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.316248 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.316251 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.316253 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.316352 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.316799 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:45.316803 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:45.316895 (+ 92us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.316987 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.317190 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"mutex_wait_us":9,"thread_start_us":108,"threads_started":1}
I20260808 05:54:45.317348 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.309926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:46253 (local address 127.2.191.126:39685)
0808 05:54:45.310060 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.310065 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.310302 (+ 237us) server_negotiation.cc:407] Connection header received
0808 05:54:45.310396 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.310399 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.310447 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.310537 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:45.311105 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.311584 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.312527 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.312777 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.312870 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.314060 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:45.314063 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:45.314065 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:45.314087 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:45.315545 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.316055 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.316058 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.316059 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.316133 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.316444 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.316447 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.316448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.316628 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:45.316706 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.317095 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.317195 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:54:45.319242 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:54:45 dist-test-slave-qg60 krb5kdc[3995](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168485, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:54:45 dist-test-slave-qg60 krb5kdc[3995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168485, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:45.347229 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.339212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39604 (local address 127.2.191.126:39685)
0808 05:54:45.339370 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.339374 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.339389 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:54:45.339453 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.339455 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.339497 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.339578 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:45.340323 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.340966 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.341771 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.341980 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.342060 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.344464 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:45.344467 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:45.344469 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:45.344494 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:45.345838 (+ 1344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.346212 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.346215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.346216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.346290 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.346527 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.346529 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.346530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.346698 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:45.346802 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.346996 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.347100 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 05:54:45.350399 4039 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:54:45.353722 4039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:45.368674 4604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.362525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56508 (local address 127.2.191.65:44497)
0808 05:54:45.363366 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.363373 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.363397 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:54:45.363481 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.363487 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.363728 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.363931 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:45.364246 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.365394 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.367307 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.367952 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.368068 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.368218 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.368416 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.368523 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":721,"thread_start_us":83,"threads_started":1}
I20260808 05:54:45.368688 4603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.362330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:44497 (local address 127.0.0.1:56508)
0808 05:54:45.362733 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.362792 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.362925 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.363921 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.363929 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.363955 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:45.364121 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.364128 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.365524 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.365527 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.367138 (+ 1611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.367149 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.368090 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.368094 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.368202 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.368247 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.368372 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.368530 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":111,"threads_started":1}
I20260808 05:54:45.369448 4607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.363172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55328 (local address 127.2.191.67:34575)
0808 05:54:45.363985 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.363999 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.364022 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:54:45.364101 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.364108 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.364287 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.364508 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:45.364713 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.365882 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.367474 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.368290 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.368392 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.368554 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.369193 (+ 639us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.369302 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":660,"thread_start_us":126,"threads_started":1}
I20260808 05:54:45.369566 4605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.362703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:34575 (local address 127.0.0.1:55328)
0808 05:54:45.362988 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.363005 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.363591 (+ 586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.364476 (+ 885us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.364479 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.364497 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:45.364595 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.364601 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.366000 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.366003 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.367317 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.367328 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.368918 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.368934 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.369027 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.369079 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.369153 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.369221 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":3,"thread_start_us":118,"threads_started":1}
I20260808 05:54:45.370335 4606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.363112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:37647 (local address 127.0.0.1:55000)
0808 05:54:45.363582 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.363596 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.363681 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.364852 (+ 1171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.364855 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.364872 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:45.365077 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.365087 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.366437 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.366441 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.367695 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.367705 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.368840 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.368846 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.370014 (+ 1168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.370041 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.370121 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.370208 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":411,"mutex_wait_us":932,"thread_start_us":105,"threads_started":1}
I20260808 05:54:45.370505 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.363283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55000 (local address 127.2.191.66:37647)
0808 05:54:45.364255 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.364266 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.364287 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:54:45.364363 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.364371 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.364541 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.364678 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:45.365207 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.366304 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.367837 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.368669 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.369091 (+ 422us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.369278 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.370240 (+ 962us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.370334 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":879,"thread_start_us":104,"threads_started":1}
I20260808 05:54:45.372088 4193 tablet_service.cc:1467] Processing CreateTablet for tablet f45c13dd35f6458886b179f3d3fd2c4f (DEFAULT_TABLE table=test-table [id=3c12950b889d4df9b93dd1ff6da08848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:45.372444 4506 tablet_service.cc:1467] Processing CreateTablet for tablet f45c13dd35f6458886b179f3d3fd2c4f (DEFAULT_TABLE table=test-table [id=3c12950b889d4df9b93dd1ff6da08848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:45.373239 4193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f45c13dd35f6458886b179f3d3fd2c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.373059 4345 tablet_service.cc:1467] Processing CreateTablet for tablet f45c13dd35f6458886b179f3d3fd2c4f (DEFAULT_TABLE table=test-table [id=3c12950b889d4df9b93dd1ff6da08848]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:45.373521 4506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f45c13dd35f6458886b179f3d3fd2c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.374039 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f45c13dd35f6458886b179f3d3fd2c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.379200 4609 tablet_bootstrap.cc:492] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: Bootstrap starting.
I20260808 05:54:45.381667 4609 tablet_bootstrap.cc:654] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.382436 4611 tablet_bootstrap.cc:492] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: Bootstrap starting.
I20260808 05:54:45.382488 4609 log.cc:824] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:45.383069 4610 tablet_bootstrap.cc:492] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: Bootstrap starting.
I20260808 05:54:45.384220 4609 tablet_bootstrap.cc:492] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: No bootstrap required, opened a new log
I20260808 05:54:45.384421 4609 ts_tablet_manager.cc:1397] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 05:54:45.384464 4611 tablet_bootstrap.cc:654] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.385200 4611 log.cc:824] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:45.387140 4611 tablet_bootstrap.cc:492] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: No bootstrap required, opened a new log
I20260808 05:54:45.387318 4611 ts_tablet_manager.cc:1397] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 05:54:45.388267 4609 raft_consensus.cc:348] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.388507 4609 raft_consensus.cc:374] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.388587 4609 raft_consensus.cc:729] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce512a711024ef69070ecf68a9bb624, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.389099 4609 consensus_queue.cc:260] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.389747 4267 heartbeater.cc:503] Master 127.2.191.126:39685 was elected leader, sending a full tablet report...
I20260808 05:54:45.390044 4609 ts_tablet_manager.cc:1428] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:54:45.390558 4611 raft_consensus.cc:348] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.391017 4611 raft_consensus.cc:374] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.391075 4611 raft_consensus.cc:729] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563041b7ceaa46dca4be691d8a2e6af4, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.391440 4611 consensus_queue.cc:260] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.392143 4610 tablet_bootstrap.cc:654] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.392343 4611 ts_tablet_manager.cc:1428] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 05:54:45.392796 4421 heartbeater.cc:503] Master 127.2.191.126:39685 was elected leader, sending a full tablet report...
I20260808 05:54:45.393030 4610 log.cc:824] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:45.395228 4610 tablet_bootstrap.cc:492] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: No bootstrap required, opened a new log
I20260808 05:54:45.395439 4610 ts_tablet_manager.cc:1397] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260808 05:54:45.398806 4610 raft_consensus.cc:348] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.399099 4610 raft_consensus.cc:374] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.399164 4610 raft_consensus.cc:729] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e30b0dd5482a481eae29c01d17622203, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.399613 4610 consensus_queue.cc:260] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.400336 4581 heartbeater.cc:503] Master 127.2.191.126:39685 was elected leader, sending a full tablet report...
I20260808 05:54:45.400625 4610 ts_tablet_manager.cc:1428] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: Time spent starting tablet: real 0.005s user 0.001s sys 0.005s
I20260808 05:54:45.407505 4614 raft_consensus.cc:482] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:45.407773 4614 raft_consensus.cc:504] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.409169 4614 leader_election.cc:288] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 563041b7ceaa46dca4be691d8a2e6af4 (127.2.191.66:37647), e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575)
I20260808 05:54:45.414723 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.409501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:34175 (local address 127.2.191.66:37647)
0808 05:54:45.409632 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.409636 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.409891 (+ 255us) server_negotiation.cc:407] Connection header received
0808 05:54:45.410037 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.410040 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.410086 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.410169 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:45.410653 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.411478 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.413370 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.413981 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.414143 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.414185 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.414513 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.414592 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:54:45.414722 4607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.409485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:58789 (local address 127.2.191.67:34575)
0808 05:54:45.409608 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.409613 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.409939 (+ 326us) server_negotiation.cc:407] Connection header received
0808 05:54:45.410018 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.410021 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.410093 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.410169 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:45.410651 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.411446 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.413370 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.413986 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.414125 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.414180 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.414532 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.414601 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 05:54:45.414800 4618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.409383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:37647 (local address 127.2.191.65:34175)
0808 05:54:45.409793 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.409809 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.409929 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.410199 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.410202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.410244 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:45.410514 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.410522 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.411595 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.411597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.413234 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.413242 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.414135 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.414139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.414352 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.414397 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.414475 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.414603 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":339,"spinlock_wait_cycles":6528,"thread_start_us":130,"threads_started":1}
I20260808 05:54:45.415200 4619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.409404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:34575 (local address 127.2.191.65:58789)
0808 05:54:45.409841 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.409855 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.409935 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.410199 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.410202 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.410242 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:45.410514 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.410522 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.411583 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.411587 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.413230 (+ 1643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.413242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.414135 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.414139 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.414311 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.414396 (+ 85us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.414475 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.414599 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":335,"spinlock_wait_cycles":27264,"thread_start_us":125,"threads_started":1}
I20260808 05:54:45.415485 4368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f45c13dd35f6458886b179f3d3fd2c4f" candidate_uuid: "0ce512a711024ef69070ecf68a9bb624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563041b7ceaa46dca4be691d8a2e6af4" is_pre_election: true
I20260808 05:54:45.415843 4368 raft_consensus.cc:2454] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce512a711024ef69070ecf68a9bb624 in term 0.
I20260808 05:54:45.415830 4527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f45c13dd35f6458886b179f3d3fd2c4f" candidate_uuid: "0ce512a711024ef69070ecf68a9bb624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e30b0dd5482a481eae29c01d17622203" is_pre_election: true
I20260808 05:54:45.416109 4527 raft_consensus.cc:2454] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ce512a711024ef69070ecf68a9bb624 in term 0.
I20260808 05:54:45.416379 4140 leader_election.cc:302] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce512a711024ef69070ecf68a9bb624, 563041b7ceaa46dca4be691d8a2e6af4; no voters:
I20260808 05:54:45.416705 4614 raft_consensus.cc:2781] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:45.416837 4614 raft_consensus.cc:482] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:45.416873 4614 raft_consensus.cc:3037] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.418028 4614 raft_consensus.cc:504] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.418382 4614 leader_election.cc:288] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [CANDIDATE]: Term 1 election: Requested vote from peers 563041b7ceaa46dca4be691d8a2e6af4 (127.2.191.66:37647), e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575)
I20260808 05:54:45.418733 4368 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f45c13dd35f6458886b179f3d3fd2c4f" candidate_uuid: "0ce512a711024ef69070ecf68a9bb624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563041b7ceaa46dca4be691d8a2e6af4"
I20260808 05:54:45.418699 4527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f45c13dd35f6458886b179f3d3fd2c4f" candidate_uuid: "0ce512a711024ef69070ecf68a9bb624" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e30b0dd5482a481eae29c01d17622203"
I20260808 05:54:45.418849 4527 raft_consensus.cc:3037] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.418849 4368 raft_consensus.cc:3037] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.420171 4527 raft_consensus.cc:2454] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce512a711024ef69070ecf68a9bb624 in term 1.
I20260808 05:54:45.420176 4368 raft_consensus.cc:2454] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ce512a711024ef69070ecf68a9bb624 in term 1.
I20260808 05:54:45.420470 4140 leader_election.cc:302] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 0ce512a711024ef69070ecf68a9bb624, 563041b7ceaa46dca4be691d8a2e6af4, e30b0dd5482a481eae29c01d17622203; no voters:
I20260808 05:54:45.420629 4614 raft_consensus.cc:2781] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:45.420900 4614 raft_consensus.cc:686] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 1 LEADER]: Becoming Leader. State: Replica: 0ce512a711024ef69070ecf68a9bb624, State: Running, Role: LEADER
I20260808 05:54:45.421242 4614 consensus_queue.cc:237] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.424469 4044 catalog_manager.cc:5495] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ce512a711024ef69070ecf68a9bb624 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "0ce512a711024ef69070ecf68a9bb624" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } health_report { overall_health: UNKNOWN } } }
I20260808 05:54:45.445533 4604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.441862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56510 (local address 127.2.191.65:44497)
0808 05:54:45.441995 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.441999 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.442013 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:54:45.442255 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.442258 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.442315 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.442403 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:45.442663 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.443160 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.444047 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.444272 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.444355 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.444654 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:45.445187 (+ 533us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:45.445278 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.445368 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.445420 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:54:45.452577 4368 raft_consensus.cc:1261] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Refusing update from remote peer 0ce512a711024ef69070ecf68a9bb624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:45.453467 4620 consensus_queue.cc:1035] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:45.453553 4527 raft_consensus.cc:1261] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Refusing update from remote peer 0ce512a711024ef69070ecf68a9bb624: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:45.454219 4620 consensus_queue.cc:1035] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:45.462667 4624 mvcc.cc:205] Tried to move back new op lower bound from 7316146116403060736 to 7316146116287954944. Current Snapshot: MvccSnapshot[applied={T|T < 7316146116403060736}]
I20260808 05:54:45.464557 4626 mvcc.cc:205] Tried to move back new op lower bound from 7316146116403060736 to 7316146116287954944. Current Snapshot: MvccSnapshot[applied={T|T < 7316146116403060736}]
I20260808 05:54:45.474435 4039 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:45.474627 4039 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:45.477263 4039 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b: Sending DeleteTablet for 3 replicas of tablet f45c13dd35f6458886b179f3d3fd2c4f
I20260808 05:54:45.478259 4506 tablet_service.cc:1514] Processing DeleteTablet for tablet f45c13dd35f6458886b179f3d3fd2c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:45 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:55328
I20260808 05:54:45.478252 4193 tablet_service.cc:1514] Processing DeleteTablet for tablet f45c13dd35f6458886b179f3d3fd2c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:45 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:56508
I20260808 05:54:45.478930 4634 tablet_replica.cc:330] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: stopping tablet replica
I20260808 05:54:45.479137 4635 tablet_replica.cc:330] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: stopping tablet replica
I20260808 05:54:45.479113 4345 tablet_service.cc:1514] Processing DeleteTablet for tablet f45c13dd35f6458886b179f3d3fd2c4f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:45 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:55000
I20260808 05:54:45.479497 4634 raft_consensus.cc:2229] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:54:45.479744 4635 raft_consensus.cc:2229] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:45.479815 4039 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:54:45.480275 4039 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:45.480489 4635 raft_consensus.cc:2258] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:45.480675 4634 raft_consensus.cc:2258] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:45.480824 4636 tablet_replica.cc:330] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: stopping tablet replica
I20260808 05:54:45.481261 4636 raft_consensus.cc:2229] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:45.481997 4636 raft_consensus.cc:2258] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:45.483527 4634 ts_tablet_manager.cc:1905] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:45.483520 4636 ts_tablet_manager.cc:1905] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:45.486385 4193 tablet_service.cc:1467] Processing CreateTablet for tablet 28dc4d0f6503452dba23c27383bc6dd5 (DEFAULT_TABLE table=test-table [id=a51d76fa97064e9a821845f1ffc22c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:45.486599 4636 ts_tablet_manager.cc:1918] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:54:45.486714 4193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28dc4d0f6503452dba23c27383bc6dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.486716 4636 log.cc:1196] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/f45c13dd35f6458886b179f3d3fd2c4f
I20260808 05:54:45.486867 4634 ts_tablet_manager.cc:1918] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:54:45.487037 4634 log.cc:1196] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/f45c13dd35f6458886b179f3d3fd2c4f
I20260808 05:54:45.487097 4636 ts_tablet_manager.cc:1939] T f45c13dd35f6458886b179f3d3fd2c4f P 563041b7ceaa46dca4be691d8a2e6af4: Deleting consensus metadata
I20260808 05:54:45.487485 4634 ts_tablet_manager.cc:1939] T f45c13dd35f6458886b179f3d3fd2c4f P 0ce512a711024ef69070ecf68a9bb624: Deleting consensus metadata
I20260808 05:54:45.488505 4026 catalog_manager.cc:4841] TS 563041b7ceaa46dca4be691d8a2e6af4 (127.2.191.66:37647): tablet f45c13dd35f6458886b179f3d3fd2c4f (table test-table [id=3c12950b889d4df9b93dd1ff6da08848]) successfully deleted
I20260808 05:54:45.489044 4506 tablet_service.cc:1467] Processing CreateTablet for tablet 28dc4d0f6503452dba23c27383bc6dd5 (DEFAULT_TABLE table=test-table [id=a51d76fa97064e9a821845f1ffc22c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:45.489087 4345 tablet_service.cc:1467] Processing CreateTablet for tablet 28dc4d0f6503452dba23c27383bc6dd5 (DEFAULT_TABLE table=test-table [id=a51d76fa97064e9a821845f1ffc22c00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:45.489195 4609 tablet_bootstrap.cc:492] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: Bootstrap starting.
I20260808 05:54:45.489343 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28dc4d0f6503452dba23c27383bc6dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.489352 4506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 28dc4d0f6503452dba23c27383bc6dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.490414 4609 tablet_bootstrap.cc:654] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.491859 4609 tablet_bootstrap.cc:492] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: No bootstrap required, opened a new log
I20260808 05:54:45.491941 4609 ts_tablet_manager.cc:1397] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:45.492013 4610 tablet_bootstrap.cc:492] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: Bootstrap starting.
I20260808 05:54:45.492281 4611 tablet_bootstrap.cc:492] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: Bootstrap starting.
I20260808 05:54:45.492540 4609 raft_consensus.cc:348] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.492694 4609 raft_consensus.cc:374] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.492754 4609 raft_consensus.cc:729] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce512a711024ef69070ecf68a9bb624, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.492885 4609 consensus_queue.cc:260] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.493216 4609 ts_tablet_manager.cc:1428] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:54:45.493249 4610 tablet_bootstrap.cc:654] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.493821 4611 tablet_bootstrap.cc:654] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.493960 4026 catalog_manager.cc:4841] TS 0ce512a711024ef69070ecf68a9bb624 (127.2.191.65:44497): tablet f45c13dd35f6458886b179f3d3fd2c4f (table test-table [id=3c12950b889d4df9b93dd1ff6da08848]) successfully deleted
I20260808 05:54:45.494923 4610 tablet_bootstrap.cc:492] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: No bootstrap required, opened a new log
I20260808 05:54:45.495036 4610 ts_tablet_manager.cc:1397] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:45.495548 4635 ts_tablet_manager.cc:1905] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:45.495594 4610 raft_consensus.cc:348] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.495733 4610 raft_consensus.cc:374] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.495781 4610 raft_consensus.cc:729] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e30b0dd5482a481eae29c01d17622203, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.495921 4610 consensus_queue.cc:260] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.496210 4610 ts_tablet_manager.cc:1428] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 05:54:45.497565 4611 tablet_bootstrap.cc:492] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: No bootstrap required, opened a new log
I20260808 05:54:45.497671 4611 ts_tablet_manager.cc:1397] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260808 05:54:45.498255 4611 raft_consensus.cc:348] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.498387 4611 raft_consensus.cc:374] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.498435 4611 raft_consensus.cc:729] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563041b7ceaa46dca4be691d8a2e6af4, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.498564 4611 consensus_queue.cc:260] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.498878 4611 ts_tablet_manager.cc:1428] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 05:54:45.499123 4635 ts_tablet_manager.cc:1918] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:54:45.499236 4635 log.cc:1196] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/f45c13dd35f6458886b179f3d3fd2c4f
I20260808 05:54:45.499630 4635 ts_tablet_manager.cc:1939] T f45c13dd35f6458886b179f3d3fd2c4f P e30b0dd5482a481eae29c01d17622203: Deleting consensus metadata
I20260808 05:54:45.501034 4029 catalog_manager.cc:4841] TS e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575): tablet f45c13dd35f6458886b179f3d3fd2c4f (table test-table [id=3c12950b889d4df9b93dd1ff6da08848]) successfully deleted
W20260808 05:54:45.554536 4582 tablet.cc:2369] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:54:45.558495 4422 tablet.cc:2369] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:54:45.582979 4268 tablet.cc:2369] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:54:45.646845 4615 raft_consensus.cc:482] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:45.647032 4615 raft_consensus.cc:504] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.648432 4615 leader_election.cc:288] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce512a711024ef69070ecf68a9bb624 (127.2.191.65:44497), e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575)
I20260808 05:54:45.653811 4607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.648969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:58163 (local address 127.2.191.67:34575)
0808 05:54:45.649284 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.649290 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.649528 (+ 238us) server_negotiation.cc:407] Connection header received
0808 05:54:45.649767 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.649771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.649821 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.649900 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:45.650176 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.650837 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.652451 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.653155 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.653275 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.653332 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.653602 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.653683 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221}
I20260808 05:54:45.653811 4604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.648848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:51907 (local address 127.2.191.65:44497)
0808 05:54:45.649152 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.649160 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.649398 (+ 238us) server_negotiation.cc:407] Connection header received
0808 05:54:45.649569 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.649573 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.649634 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.649717 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:45.650379 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.651115 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.652340 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.653056 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.653211 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.653279 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.653602 (+ 323us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.653683 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196}
I20260808 05:54:45.653831 4640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.648727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:44497 (local address 127.2.191.66:51907)
0808 05:54:45.649273 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.649289 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.649424 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.649766 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.649769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.649784 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:45.649950 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.650229 (+ 279us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.651277 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.651288 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.652190 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.652200 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.653255 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.653260 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.653408 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.653450 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.653543 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.653633 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"mutex_wait_us":5,"thread_start_us":109,"threads_started":1}
I20260808 05:54:45.653836 4641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.648748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:34575 (local address 127.2.191.66:58163)
0808 05:54:45.649395 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.649414 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.649620 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.649945 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.649948 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.649965 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:45.650047 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.650053 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.650974 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.650978 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.652247 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.652259 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.653284 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.653287 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.653427 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.653465 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.653571 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.653633 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"mutex_wait_us":223,"thread_start_us":75,"threads_started":1}
I20260808 05:54:45.654597 4215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28dc4d0f6503452dba23c27383bc6dd5" candidate_uuid: "563041b7ceaa46dca4be691d8a2e6af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce512a711024ef69070ecf68a9bb624" is_pre_election: true
I20260808 05:54:45.654629 4527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28dc4d0f6503452dba23c27383bc6dd5" candidate_uuid: "563041b7ceaa46dca4be691d8a2e6af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e30b0dd5482a481eae29c01d17622203" is_pre_election: true
I20260808 05:54:45.654793 4527 raft_consensus.cc:2454] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563041b7ceaa46dca4be691d8a2e6af4 in term 0.
I20260808 05:54:45.654851 4215 raft_consensus.cc:2454] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563041b7ceaa46dca4be691d8a2e6af4 in term 0.
I20260808 05:54:45.655172 4298 leader_election.cc:302] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563041b7ceaa46dca4be691d8a2e6af4, e30b0dd5482a481eae29c01d17622203; no voters:
I20260808 05:54:45.655470 4615 raft_consensus.cc:2781] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:45.655536 4615 raft_consensus.cc:482] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:45.655577 4615 raft_consensus.cc:3037] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.656807 4615 raft_consensus.cc:504] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.657163 4615 leader_election.cc:288] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce512a711024ef69070ecf68a9bb624 (127.2.191.65:44497), e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575)
I20260808 05:54:45.657505 4527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28dc4d0f6503452dba23c27383bc6dd5" candidate_uuid: "563041b7ceaa46dca4be691d8a2e6af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e30b0dd5482a481eae29c01d17622203"
I20260808 05:54:45.657505 4215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28dc4d0f6503452dba23c27383bc6dd5" candidate_uuid: "563041b7ceaa46dca4be691d8a2e6af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce512a711024ef69070ecf68a9bb624"
I20260808 05:54:45.657646 4215 raft_consensus.cc:3037] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.657646 4527 raft_consensus.cc:3037] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.658780 4215 raft_consensus.cc:2454] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563041b7ceaa46dca4be691d8a2e6af4 in term 1.
I20260808 05:54:45.658780 4527 raft_consensus.cc:2454] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563041b7ceaa46dca4be691d8a2e6af4 in term 1.
I20260808 05:54:45.659111 4294 leader_election.cc:302] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce512a711024ef69070ecf68a9bb624, 563041b7ceaa46dca4be691d8a2e6af4; no voters:
I20260808 05:54:45.659313 4615 raft_consensus.cc:2781] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:45.659546 4615 raft_consensus.cc:686] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 LEADER]: Becoming Leader. State: Replica: 563041b7ceaa46dca4be691d8a2e6af4, State: Running, Role: LEADER
I20260808 05:54:45.659835 4615 consensus_queue.cc:237] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.662142 4044 catalog_manager.cc:5495] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 563041b7ceaa46dca4be691d8a2e6af4 (127.2.191.66). New cstate: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } health_report { overall_health: UNKNOWN } } }
Aug 08 05:54:45 dist-test-slave-qg60 krb5kdc[3995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168484, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:45.715076 4649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.706601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39685 (local address 127.0.0.1:39620)
0808 05:54:45.706900 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.706914 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.707034 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.707344 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.707347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.707757 (+ 410us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:45.707855 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.707861 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.708616 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.708619 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.709238 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.709247 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.709688 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.709691 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.709757 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.710293 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:45.710304 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:45.711776 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:45.713544 (+ 1768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.713552 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.713557 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.713790 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.714072 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:45.714075 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:45.714077 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:45.714174 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:45.714540 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:45.714546 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:45.714658 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.714765 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.714888 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":125,"threads_started":1}
I20260808 05:54:45.715106 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.706684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39620 (local address 127.2.191.126:39685)
0808 05:54:45.706831 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.706835 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.706990 (+ 155us) server_negotiation.cc:407] Connection header received
0808 05:54:45.707163 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.707166 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.707237 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.707307 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:45.707963 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.708516 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.709343 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.709564 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.709642 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.711906 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:45.711909 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:45.711911 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:45.711933 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:45.713437 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.713879 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.713882 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.713883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.713956 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.714267 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.714269 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.714270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.714434 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:45.714510 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.714872 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.714984 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 05:54:45.719340 4044 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:39620:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:54:45.720049 4044 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:45.724756 4193 tablet_service.cc:1467] Processing CreateTablet for tablet e7a6714515ff40de85f10436b17383a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2f3911aa93114a14a9eed5d83165567d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:54:45.724897 4345 tablet_service.cc:1467] Processing CreateTablet for tablet e7a6714515ff40de85f10436b17383a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2f3911aa93114a14a9eed5d83165567d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:54:45.725198 4193 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7a6714515ff40de85f10436b17383a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.725232 4345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7a6714515ff40de85f10436b17383a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.725176 4506 tablet_service.cc:1467] Processing CreateTablet for tablet e7a6714515ff40de85f10436b17383a5 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2f3911aa93114a14a9eed5d83165567d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:54:45.725557 4506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7a6714515ff40de85f10436b17383a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:45.728168 4609 tablet_bootstrap.cc:492] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: Bootstrap starting.
I20260808 05:54:45.728299 4611 tablet_bootstrap.cc:492] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: Bootstrap starting.
I20260808 05:54:45.728344 4610 tablet_bootstrap.cc:492] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: Bootstrap starting.
I20260808 05:54:45.729267 4609 tablet_bootstrap.cc:654] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.729523 4610 tablet_bootstrap.cc:654] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.729637 4611 tablet_bootstrap.cc:654] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:45.730701 4609 tablet_bootstrap.cc:492] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: No bootstrap required, opened a new log
I20260808 05:54:45.730829 4609 ts_tablet_manager.cc:1397] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:45.731141 4610 tablet_bootstrap.cc:492] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: No bootstrap required, opened a new log
I20260808 05:54:45.731263 4610 ts_tablet_manager.cc:1397] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 05:54:45.731366 4611 tablet_bootstrap.cc:492] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: No bootstrap required, opened a new log
I20260808 05:54:45.731297 4609 raft_consensus.cc:348] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.731418 4609 raft_consensus.cc:374] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.731456 4611 ts_tablet_manager.cc:1397] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:45.731451 4609 raft_consensus.cc:729] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ce512a711024ef69070ecf68a9bb624, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.731642 4609 consensus_queue.cc:260] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.731890 4614 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.731873 4610 raft_consensus.cc:348] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.731935 4611 raft_consensus.cc:348] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.732035 4614 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:45.732033 4610 raft_consensus.cc:374] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.732033 4611 raft_consensus.cc:374] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:45.732077 4610 raft_consensus.cc:729] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e30b0dd5482a481eae29c01d17622203, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.732080 4611 raft_consensus.cc:729] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563041b7ceaa46dca4be691d8a2e6af4, State: Initialized, Role: FOLLOWER
I20260808 05:54:45.732200 4611 consensus_queue.cc:260] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.732213 4610 consensus_queue.cc:260] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.732456 4611 ts_tablet_manager.cc:1428] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:54:45.732538 4610 ts_tablet_manager.cc:1428] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 05:54:45.732692 4615 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.732860 4615 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:45.733349 4617 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.733527 4617 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:45.733785 4609 ts_tablet_manager.cc:1428] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 05:54:45.807996 4615 raft_consensus.cc:482] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:45.808209 4615 raft_consensus.cc:504] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.808779 4615 leader_election.cc:288] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ce512a711024ef69070ecf68a9bb624 (127.2.191.65:44497), e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575)
I20260808 05:54:45.809235 4215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a6714515ff40de85f10436b17383a5" candidate_uuid: "563041b7ceaa46dca4be691d8a2e6af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce512a711024ef69070ecf68a9bb624" is_pre_election: true
I20260808 05:54:45.809254 4527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a6714515ff40de85f10436b17383a5" candidate_uuid: "563041b7ceaa46dca4be691d8a2e6af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e30b0dd5482a481eae29c01d17622203" is_pre_election: true
I20260808 05:54:45.809397 4215 raft_consensus.cc:2454] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563041b7ceaa46dca4be691d8a2e6af4 in term 0.
I20260808 05:54:45.809428 4527 raft_consensus.cc:2454] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563041b7ceaa46dca4be691d8a2e6af4 in term 0.
I20260808 05:54:45.809725 4294 leader_election.cc:302] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ce512a711024ef69070ecf68a9bb624, 563041b7ceaa46dca4be691d8a2e6af4; no voters:
I20260808 05:54:45.809923 4615 raft_consensus.cc:2781] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:45.809984 4615 raft_consensus.cc:482] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:45.810037 4615 raft_consensus.cc:3037] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.811250 4615 raft_consensus.cc:504] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.811651 4615 leader_election.cc:288] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [CANDIDATE]: Term 1 election: Requested vote from peers 0ce512a711024ef69070ecf68a9bb624 (127.2.191.65:44497), e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575)
I20260808 05:54:45.812011 4215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a6714515ff40de85f10436b17383a5" candidate_uuid: "563041b7ceaa46dca4be691d8a2e6af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ce512a711024ef69070ecf68a9bb624"
I20260808 05:54:45.812045 4527 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7a6714515ff40de85f10436b17383a5" candidate_uuid: "563041b7ceaa46dca4be691d8a2e6af4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e30b0dd5482a481eae29c01d17622203"
I20260808 05:54:45.812150 4527 raft_consensus.cc:3037] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.812184 4215 raft_consensus.cc:3037] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:45.813181 4527 raft_consensus.cc:2454] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563041b7ceaa46dca4be691d8a2e6af4 in term 1.
I20260808 05:54:45.813318 4215 raft_consensus.cc:2454] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563041b7ceaa46dca4be691d8a2e6af4 in term 1.
I20260808 05:54:45.813524 4298 leader_election.cc:302] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563041b7ceaa46dca4be691d8a2e6af4, e30b0dd5482a481eae29c01d17622203; no voters:
I20260808 05:54:45.813709 4615 raft_consensus.cc:2781] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:45.813820 4615 raft_consensus.cc:686] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 LEADER]: Becoming Leader. State: Replica: 563041b7ceaa46dca4be691d8a2e6af4, State: Running, Role: LEADER
I20260808 05:54:45.813977 4615 consensus_queue.cc:237] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } }
I20260808 05:54:45.814814 4642 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: TxnStatusTablet state changed. Reason: New leader 563041b7ceaa46dca4be691d8a2e6af4. Latest consensus state: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.814934 4642 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:54:45.815552 4655 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:54:45.815742 4655 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:54:45.815972 4044 catalog_manager.cc:5495] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 563041b7ceaa46dca4be691d8a2e6af4 (127.2.191.66). New cstate: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } health_report { overall_health: UNKNOWN } } }
I20260808 05:54:45.839196 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.835054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55008 (local address 127.2.191.66:37647)
0808 05:54:45.835193 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.835203 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.835214 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:54:45.835275 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.835277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.835329 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.835448 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:45.835749 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.836266 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.837445 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.837675 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.837813 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.838336 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:45.838778 (+ 442us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:45.838910 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.838994 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.839051 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 05:54:45.839201 4649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.834777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:37647 (local address 127.0.0.1:55008)
0808 05:54:45.834917 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.834936 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.835050 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.835486 (+ 436us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.835489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.835497 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:54:45.835630 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.835636 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.836383 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.836387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.837318 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.837329 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.837981 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.837987 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.838134 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.838183 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:54:45.838884 (+ 701us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:54:45.838903 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.838983 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.839084 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:54:45.842269 4527 raft_consensus.cc:1261] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Refusing update from remote peer 563041b7ceaa46dca4be691d8a2e6af4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:45.842921 4215 raft_consensus.cc:1261] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Refusing update from remote peer 563041b7ceaa46dca4be691d8a2e6af4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:45.842842 4642 consensus_queue.cc:1035] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:45.843443 4642 consensus_queue.cc:1035] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:45.844419 4617 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: TxnStatusTablet state changed. Reason: New leader 563041b7ceaa46dca4be691d8a2e6af4. Latest consensus state: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.844556 4617 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:45.846383 4614 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: TxnStatusTablet state changed. Reason: New leader 563041b7ceaa46dca4be691d8a2e6af4. Latest consensus state: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.846524 4614 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:45.848449 4642 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.848567 4642 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:54:45.850579 4617 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.850701 4617 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P e30b0dd5482a481eae29c01d17622203: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:45.853489 4615 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.853621 4615 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P 563041b7ceaa46dca4be691d8a2e6af4: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:54:45.854350 4614 tablet_replica.cc:439] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "563041b7ceaa46dca4be691d8a2e6af4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 } } peers { permanent_uuid: "563041b7ceaa46dca4be691d8a2e6af4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 37647 } } peers { permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 } } }
I20260808 05:54:45.854465 4614 tablet_replica.cc:442] T e7a6714515ff40de85f10436b17383a5 P 0ce512a711024ef69070ecf68a9bb624: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:45.854564 4623 mvcc.cc:205] Tried to move back new op lower bound from 7316146118004551680 to 7316146117895671808. Current Snapshot: MvccSnapshot[applied={T|T < 7316146118004551680 or (T in {7316146118004551680})}]
I20260808 05:54:45.860589 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.857285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55010 (local address 127.2.191.66:37647)
0808 05:54:45.857396 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.857400 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.857480 (+ 80us) server_negotiation.cc:407] Connection header received
0808 05:54:45.857624 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.857626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.857726 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.857804 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:45.858070 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.858584 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.859484 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.859724 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.859835 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.860112 (+ 277us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:45.860194 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:45.860278 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.860371 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.860422 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:54:45.872823 4608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.869038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:59403 (local address 127.2.191.66:37647)
0808 05:54:45.869170 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.869174 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.869473 (+ 299us) server_negotiation.cc:407] Connection header received
0808 05:54:45.869656 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.869658 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.869699 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.869824 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:45.870247 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.870765 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.871649 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.871862 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.871972 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.872271 (+ 299us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:45.872348 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:45.872433 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.872517 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.872626 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":51}
I20260808 05:54:45.872831 4664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.868986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:37647 (local address 127.2.191.66:59403)
0808 05:54:45.869379 (+ 393us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:45.869394 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:45.869562 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:45.869832 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:45.869835 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:45.869841 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:54:45.870130 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.870137 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.870877 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.870882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.871524 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:45.871532 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.871991 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.871995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:45.872086 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.872129 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:54:45.872439 (+ 310us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:54:45.872446 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 05:54:45.872509 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 05:54:45.872655 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":297,"mutex_wait_us":72,"thread_start_us":91,"threads_started":1}
I20260808 05:54:45.880745 4527 raft_consensus.cc:1261] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Refusing update from remote peer 563041b7ceaa46dca4be691d8a2e6af4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:45.880781 4215 raft_consensus.cc:1261] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Refusing update from remote peer 563041b7ceaa46dca4be691d8a2e6af4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:45.881130 4642 consensus_queue.cc:1035] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e30b0dd5482a481eae29c01d17622203" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:45.881304 4661 consensus_queue.cc:1035] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ce512a711024ef69070ecf68a9bb624" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 44497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:45.929086 4044 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:45.929276 4044 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:45.931432 4044 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c82fa1492da340e498dcea6ef101d92b: Sending DeleteTablet for 3 replicas of tablet 28dc4d0f6503452dba23c27383bc6dd5
I20260808 05:54:45.932116 4193 tablet_service.cc:1514] Processing DeleteTablet for tablet 28dc4d0f6503452dba23c27383bc6dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:45 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:56508
I20260808 05:54:45.932174 4506 tablet_service.cc:1514] Processing DeleteTablet for tablet 28dc4d0f6503452dba23c27383bc6dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:45 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:55328
I20260808 05:54:45.932334 4634 tablet_replica.cc:330] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: stopping tablet replica
I20260808 05:54:45.932371 4635 tablet_replica.cc:330] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: stopping tablet replica
I20260808 05:54:45.932461 4634 raft_consensus.cc:2229] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:45.932514 4635 raft_consensus.cc:2229] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:45.932595 4634 raft_consensus.cc:2258] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:45.932646 4635 raft_consensus.cc:2258] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:45.932950 4345 tablet_service.cc:1514] Processing DeleteTablet for tablet 28dc4d0f6503452dba23c27383bc6dd5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:45 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:55000
I20260808 05:54:45.933301 4636 tablet_replica.cc:330] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: stopping tablet replica
I20260808 05:54:45.933450 4636 raft_consensus.cc:2229] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:54:45.933665 4634 ts_tablet_manager.cc:1905] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:45.933791 4636 raft_consensus.cc:2258] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:45.934602 4636 ts_tablet_manager.cc:1905] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:45.936771 4634 ts_tablet_manager.cc:1918] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:45.936854 4634 log.cc:1196] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/28dc4d0f6503452dba23c27383bc6dd5
I20260808 05:54:45.937146 4634 ts_tablet_manager.cc:1939] T 28dc4d0f6503452dba23c27383bc6dd5 P 0ce512a711024ef69070ecf68a9bb624: Deleting consensus metadata
I20260808 05:54:45.937601 4636 ts_tablet_manager.cc:1918] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:45.937711 4636 log.cc:1196] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/28dc4d0f6503452dba23c27383bc6dd5
I20260808 05:54:45.937911 4026 catalog_manager.cc:4841] TS 0ce512a711024ef69070ecf68a9bb624 (127.2.191.65:44497): tablet 28dc4d0f6503452dba23c27383bc6dd5 (table test-table [id=a51d76fa97064e9a821845f1ffc22c00]) successfully deleted
I20260808 05:54:45.938030 4636 ts_tablet_manager.cc:1939] T 28dc4d0f6503452dba23c27383bc6dd5 P 563041b7ceaa46dca4be691d8a2e6af4: Deleting consensus metadata
I20260808 05:54:45.938730 4026 catalog_manager.cc:4841] TS 563041b7ceaa46dca4be691d8a2e6af4 (127.2.191.66:37647): tablet 28dc4d0f6503452dba23c27383bc6dd5 (table test-table [id=a51d76fa97064e9a821845f1ffc22c00]) successfully deleted
I20260808 05:54:45.941474 4635 ts_tablet_manager.cc:1905] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:45.944775 4635 ts_tablet_manager.cc:1918] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:45.944881 4635 log.cc:1196] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/28dc4d0f6503452dba23c27383bc6dd5
I20260808 05:54:45.945199 4635 ts_tablet_manager.cc:1939] T 28dc4d0f6503452dba23c27383bc6dd5 P e30b0dd5482a481eae29c01d17622203: Deleting consensus metadata
Aug 08 05:54:45 dist-test-slave-qg60 krb5kdc[3995](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168485, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:54:45.945914 4029 catalog_manager.cc:4841] TS e30b0dd5482a481eae29c01d17622203 (127.2.191.67:34575): tablet 28dc4d0f6503452dba23c27383bc6dd5 (table test-table [id=a51d76fa97064e9a821845f1ffc22c00]) successfully deleted
I20260808 05:54:45.950519 4604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.937308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56522 (local address 127.2.191.65:44497)
0808 05:54:45.937464 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.937471 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.938895 (+ 1424us) server_negotiation.cc:407] Connection header received
0808 05:54:45.939106 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.939109 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.939158 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.939258 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:45.939987 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.940517 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.941794 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.942138 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.942253 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.946452 (+ 4199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:45.946481 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:45.946497 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:45.946527 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:45.948489 (+ 1962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.949035 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.949043 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.949045 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.949147 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.949417 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.949421 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.949423 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.949751 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:45.949972 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.950186 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.950318 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 05:54:45.951129 4260 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56522
I20260808 05:54:45.961747 4098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:45.953204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39628 (local address 127.2.191.126:39685)
0808 05:54:45.953351 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:45.953354 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:45.953369 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:54:45.953463 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:45.953465 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:45.953506 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:45.953577 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:45.954403 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.954932 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.956192 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:45.956423 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:45.956517 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:45.958312 (+ 1795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:45.958315 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:45.958317 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:45.958342 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:45.959828 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.960325 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.960328 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.960329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.960409 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:45.960708 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:45.960710 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:45.960711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:45.960952 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:45.961064 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:45.961369 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 05:54:45.961532 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 05:54:45.962308 4044 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39628
I20260808 05:54:45.963912 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 4124
I20260808 05:54:45.975775 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 4276
I20260808 05:54:45.983820 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 4431
I20260808 05:54:45.991329 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 4010
2026-08-08T05:54:45Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2890 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:54:46 dist-test-slave-qg60 krb5kdc[4674](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:54:46 dist-test-slave-qg60 krb5kdc[4674](info): set up 2 sockets
Aug 08 05:54:46 dist-test-slave-qg60 krb5kdc[4674](info): commencing operation
krb5kdc: starting...
W20260808 05:54:47.096971 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.080s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:54:47 dist-test-slave-qg60 krb5kdc[4674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:54:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:54:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:54:47.232185 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:38135
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:38135
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:47.345580 4688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:47.345906 4688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:47.345990 4688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:47.350077 4688 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:54:47.350172 4688 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:54:47.350203 4688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:47.350250 4688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:47.350287 4688 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:54:47.350322 4688 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:54:47.355957 4688 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:38135
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:38135
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:47.357146 4688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:47.358224 4688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:47.367328 4698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:47.367388 4695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:47.367408 4694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:47.367679 4688 server_base.cc:1034] running on GCE node
I20260808 05:54:47.368316 4688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:47.369664 4688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:47.370855 4688 hybrid_clock.cc:648] HybridClock initialized: now 1786168487370820 us; error 47 us; skew 500 ppm
Aug 08 05:54:47 dist-test-slave-qg60 krb5kdc[4674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168487, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:47.373867 4688 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:54:47.374802 4688 webserver.cc:460] Webserver started at http://127.2.191.126:40801/ using document root <none> and password file <none>
I20260808 05:54:47.375349 4688 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:47.375412 4688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:47.375584 4688 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:47.377772 4688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "7f71bb3392024099b44a28016d1fddbb"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "31530c66adfeeea5c07217cea4342f95"
server_key_iv: "63836c55fe7a4de11444f636eee811fb"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.378306 4688 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "7f71bb3392024099b44a28016d1fddbb"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "31530c66adfeeea5c07217cea4342f95"
server_key_iv: "63836c55fe7a4de11444f636eee811fb"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.382342 4688 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:54:47.385020 4705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:47.386355 4688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:54:47.386510 4688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "7f71bb3392024099b44a28016d1fddbb"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "31530c66adfeeea5c07217cea4342f95"
server_key_iv: "63836c55fe7a4de11444f636eee811fb"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.386648 4688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:47.415129 4688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:47.418783 4688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:47.419008 4688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:47.427722 4688 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:38135
I20260808 05:54:47.427735 4778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:38135 every 8 connection(s)
I20260808 05:54:47.428720 4688 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:54:47.429595 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 4688
I20260808 05:54:47.429736 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:54:47.429996 2813 external_mini_cluster.cc:1428] Setting key 1b79264c87d4c48fea583de48e1e05bf
I20260808 05:54:47.431958 4779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:47.438992 4779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: Bootstrap starting.
Aug 08 05:54:47 dist-test-slave-qg60 krb5kdc[4674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168487, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:47.441892 4779 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:47.443359 4779 log.cc:824] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:47.445331 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.431344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38120 (local address 127.2.191.126:38135)
0808 05:54:47.431749 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:47.431764 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:47.431815 (+ 51us) server_negotiation.cc:407] Connection header received
0808 05:54:47.432494 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:47.432510 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:47.432901 (+ 391us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:47.433186 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:47.434081 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.435088 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.436298 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.436835 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.436957 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.439837 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:47.439845 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:47.439860 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:47.439892 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:47.441906 (+ 2014us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:47.442383 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:47.442391 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:47.442400 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:47.442601 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:47.442878 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:47.442882 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:47.442883 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:47.443417 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:47.443610 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:47.443899 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 05:54:47.444364 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":132,"threads_started":1}
I20260808 05:54:47.445858 4779 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: No bootstrap required, opened a new log
I20260808 05:54:47.449182 4779 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f71bb3392024099b44a28016d1fddbb" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38135 } }
I20260808 05:54:47.449405 4779 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:47.449440 4779 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f71bb3392024099b44a28016d1fddbb, State: Initialized, Role: FOLLOWER
I20260808 05:54:47.449848 4779 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f71bb3392024099b44a28016d1fddbb" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38135 } }
I20260808 05:54:47.449975 4779 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:54:47.450071 4779 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:54:47.450196 4779 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:47.451321 4779 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f71bb3392024099b44a28016d1fddbb" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38135 } }
I20260808 05:54:47.451642 4779 leader_election.cc:302] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f71bb3392024099b44a28016d1fddbb; no voters:
I20260808 05:54:47.451972 4779 leader_election.cc:288] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:54:47.452073 4785 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:47.452260 4785 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [term 1 LEADER]: Becoming Leader. State: Replica: 7f71bb3392024099b44a28016d1fddbb, State: Running, Role: LEADER
I20260808 05:54:47.452579 4785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f71bb3392024099b44a28016d1fddbb" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38135 } }
I20260808 05:54:47.453330 4779 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:54:47.454493 4787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f71bb3392024099b44a28016d1fddbb. Latest consensus state: current_term: 1 leader_uuid: "7f71bb3392024099b44a28016d1fddbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f71bb3392024099b44a28016d1fddbb" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38135 } } }
I20260808 05:54:47.454501 4786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f71bb3392024099b44a28016d1fddbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f71bb3392024099b44a28016d1fddbb" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 38135 } } }
I20260808 05:54:47.454633 4787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:47.454651 4786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:47.456002 4794 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:54:47.458832 4794 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:54:47.464700 4794 catalog_manager.cc:1347] Generated new cluster ID: 48d03a3967a94c598b6c96240f841fc2
I20260808 05:54:47.464833 4794 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:54:47.484336 4794 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:54:47.485687 4794 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:54:47.503543 4794 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: Generated new TSK 0
I20260808 05:54:47.504472 4794 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:54:47.546542 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38135
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:47.665808 4806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:47.666250 4806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:47.666364 4806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:47.670511 4806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:47.670612 4806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:47.670691 4806 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:54:47.670735 4806 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:54:47.670799 4806 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:54:47.676273 4806 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:38135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:47.677510 4806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:47.678607 4806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:47.688515 4813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:47.688525 4812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:47.688587 4806 server_base.cc:1034] running on GCE node
W20260808 05:54:47.688534 4815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:47.689193 4806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:47.689873 4806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:47.691043 4806 hybrid_clock.cc:648] HybridClock initialized: now 1786168487691028 us; error 33 us; skew 500 ppm
Aug 08 05:54:47 dist-test-slave-qg60 krb5kdc[4674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168487, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:47.694123 4806 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:54:47.694989 4806 webserver.cc:460] Webserver started at http://127.2.191.65:36435/ using document root <none> and password file <none>
I20260808 05:54:47.695591 4806 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:47.695657 4806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:47.695885 4806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:47.698091 4806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "f4ac24136da54624a7c978e9c839f7d0"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "a74c1d9de6bb3ec00c4fc38633345923"
server_key_iv: "979c340ea8234eb4d1d3c84084795488"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.698701 4806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "f4ac24136da54624a7c978e9c839f7d0"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "a74c1d9de6bb3ec00c4fc38633345923"
server_key_iv: "979c340ea8234eb4d1d3c84084795488"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.702664 4806 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:54:47.705320 4823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:47.706768 4806 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:54:47.706926 4806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "f4ac24136da54624a7c978e9c839f7d0"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "a74c1d9de6bb3ec00c4fc38633345923"
server_key_iv: "979c340ea8234eb4d1d3c84084795488"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.707062 4806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:47.728267 4806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:47.731895 4806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:47.732115 4806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:47.733690 4806 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:47.733767 4806 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:47.733843 4806 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:47.733897 4806 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:54:47 dist-test-slave-qg60 krb5kdc[4674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168487, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:47.745448 4806 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:33429
I20260808 05:54:47.745482 4949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:33429 every 8 connection(s)
I20260808 05:54:47.746515 4806 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:54:47.748361 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.734539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:46213 (local address 127.2.191.126:38135)
0808 05:54:47.734734 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:47.734741 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:47.735572 (+ 831us) server_negotiation.cc:407] Connection header received
0808 05:54:47.736710 (+ 1138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:47.736715 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:47.736808 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:47.736879 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:47.738355 (+ 1476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.739000 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.740265 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.740590 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.740710 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.744395 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:47.744399 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:47.744402 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:47.744433 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:47.746163 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:47.746794 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:47.746797 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:47.746798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:47.746882 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:47.747333 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:47.747336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:47.747338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:47.747562 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:47.747644 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:47.748105 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 05:54:47.748237 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 05:54:47.749328 4833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.734929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38135 (local address 127.2.191.65:46213)
0808 05:54:47.735387 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:47.735439 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:47.736418 (+ 979us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:47.737306 (+ 888us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:47.737314 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:47.737663 (+ 349us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:47.738188 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:47.738209 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.739140 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.739144 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:47.740105 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:47.740115 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.740779 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.740784 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:47.741021 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.741749 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:47.741768 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:47.744205 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:47.746294 (+ 2089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:47.746300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:47.746315 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:47.746683 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:47.747013 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:47.747019 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:47.747022 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:47.747214 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:47.747639 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:47.747644 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:47.747874 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 05:54:47.748033 (+ 159us) client_negotiation.cc:240] Negotiation successful
0808 05:54:47.748296 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"thread_start_us":135,"threads_started":1}
I20260808 05:54:47.750792 4950 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38135
I20260808 05:54:47.750962 4950 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:47.751549 4950 heartbeater.cc:511] Master 127.2.191.126:38135 requested a full tablet report, sending...
I20260808 05:54:47.753399 4726 ts_manager.cc:194] Registered new tserver with Master: f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429)
I20260808 05:54:47.754921 4726 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:46213
I20260808 05:54:47.755125 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 4806
I20260808 05:54:47.755246 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:54:47.755568 2813 external_mini_cluster.cc:1428] Setting key 8d6637b7cc9114ea2665e9ac191e7309
I20260808 05:54:47.762439 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.753171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:34797 (local address 127.2.191.126:38135)
0808 05:54:47.753327 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:47.753331 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:47.753570 (+ 239us) server_negotiation.cc:407] Connection header received
0808 05:54:47.753689 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:47.753692 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:47.753745 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:47.753814 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:47.754430 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.754978 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.757109 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.757436 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.757546 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.758866 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:47.758872 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:47.758877 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:47.758910 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:47.760677 (+ 1767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:47.761251 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:47.761254 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:47.761255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:47.761336 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:47.761648 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:47.761650 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:47.761651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:47.761814 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:47.761891 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:47.762212 (+ 321us) server_negotiation.cc:299] Negotiation successful
0808 05:54:47.762310 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 05:54:47.762662 4957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.753127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38135 (local address 127.2.191.65:34797)
0808 05:54:47.753463 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:47.753481 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:47.753590 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:47.753882 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:47.753885 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:47.754115 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:47.754277 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:47.754286 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.756024 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.756028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:47.756935 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:47.756946 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.757666 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.757669 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:47.757743 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.758332 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:47.758348 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:47.758713 (+ 365us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:47.760845 (+ 2132us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:47.760852 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:47.760856 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:47.761138 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:47.761438 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:47.761443 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:47.761448 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:47.761556 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:47.761910 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:47.761916 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:47.762042 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 05:54:47.762162 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 05:54:47.762344 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"mutex_wait_us":1,"thread_start_us":130,"threads_started":1}
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:54:47.788081 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38135
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:47.903179 4960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:47.903462 4960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:47.903512 4960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:47.907501 4960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:47.907562 4960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:47.907603 4960 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:54:47.907617 4960 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:54:47.907649 4960 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:54:47.913172 4960 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:38135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:47.914237 4960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:47.915253 4960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:47.925529 4967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:47.925537 4969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:47.925572 4966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:47.925844 4960 server_base.cc:1034] running on GCE node
I20260808 05:54:47.926316 4960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:47.926970 4960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:47.928167 4960 hybrid_clock.cc:648] HybridClock initialized: now 1786168487928137 us; error 40 us; skew 500 ppm
Aug 08 05:54:47 dist-test-slave-qg60 krb5kdc[4674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168487, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:47.931259 4960 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:54:47.932222 4960 webserver.cc:460] Webserver started at http://127.2.191.66:36429/ using document root <none> and password file <none>
I20260808 05:54:47.932870 4960 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:47.932966 4960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:47.933216 4960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:47.935374 4960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "f11c856673ba4a6fbdf3bb17389fe4c4"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "9385a6da06b3da9a763b3943f61ddfb5"
server_key_iv: "2d9935e295a47c627e34044d52106985"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.935977 4960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "f11c856673ba4a6fbdf3bb17389fe4c4"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "9385a6da06b3da9a763b3943f61ddfb5"
server_key_iv: "2d9935e295a47c627e34044d52106985"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.940022 4960 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 05:54:47.942896 4976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:47.944307 4960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:47.944475 4960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "f11c856673ba4a6fbdf3bb17389fe4c4"
format_stamp: "Formatted at 2026-08-08 05:54:47 on dist-test-slave-qg60"
server_key: "9385a6da06b3da9a763b3943f61ddfb5"
server_key_iv: "2d9935e295a47c627e34044d52106985"
server_key_version: "encryptionkey@0"
I20260808 05:54:47.944631 4960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:47.967525 4960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:47.970813 4960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:47.971040 4960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:47.972579 4960 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:47.972630 4960 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:47.972671 4960 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:47.972755 4960 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:54:47 dist-test-slave-qg60 krb5kdc[4674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168487, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:47.984368 4960 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:33877
I20260808 05:54:47.984462 5101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:33877 every 8 connection(s)
I20260808 05:54:47.985574 4960 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:54:47.986033 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 4960
I20260808 05:54:47.986157 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:54:47.986431 2813 external_mini_cluster.cc:1428] Setting key b9af8cf02c99f0b05c111369dc37f59f
I20260808 05:54:47.988655 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.973798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:47699 (local address 127.2.191.126:38135)
0808 05:54:47.973946 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:47.973951 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:47.975179 (+ 1228us) server_negotiation.cc:407] Connection header received
0808 05:54:47.976687 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:47.976693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:47.976789 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:47.976900 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:47.978584 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.979183 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.980602 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.980986 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.981119 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.984189 (+ 3070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:47.984193 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:47.984195 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:47.984223 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:47.986153 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:47.986865 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:47.986869 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:47.986871 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:47.986980 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:47.987402 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:47.987405 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:47.987407 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:47.987642 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:47.987744 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:47.988354 (+ 610us) server_negotiation.cc:299] Negotiation successful
0808 05:54:47.988487 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:54:47.989491 4985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.974397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38135 (local address 127.2.191.66:47699)
0808 05:54:47.975002 (+ 605us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:47.975054 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:47.976352 (+ 1298us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:47.977086 (+ 734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:47.977094 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:47.977663 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:47.978418 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:47.978434 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.979325 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.979329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:47.980462 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:47.980473 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.981164 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.981169 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:47.981353 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.982058 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:47.982084 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:47.983960 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:47.986304 (+ 2344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:47.986310 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:47.986325 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:47.986725 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:47.987107 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:47.987111 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:47.987113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:47.987300 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:47.987796 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:47.987804 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:47.988099 (+ 295us) client_negotiation.cc:769] Sending connection context
0808 05:54:47.988304 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 05:54:47.988641 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":153,"threads_started":1}
I20260808 05:54:47.991401 5102 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38135
I20260808 05:54:47.991591 5102 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:47.992084 5102 heartbeater.cc:511] Master 127.2.191.126:38135 requested a full tablet report, sending...
I20260808 05:54:47.993281 4727 ts_manager.cc:194] Registered new tserver with Master: f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877)
I20260808 05:54:47.994072 4727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:47699
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:54:48.002792 5109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.993905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38135 (local address 127.2.191.66:59921)
0808 05:54:47.994400 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:47.994420 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:47.994596 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:47.994916 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:47.994921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:47.995190 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:47.995324 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:47.995331 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.996332 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.996338 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:47.997510 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:47.997523 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.998033 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.998040 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:47.998165 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.998710 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:47.998726 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:47.999262 (+ 536us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:48.001097 (+ 1835us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:48.001104 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:48.001109 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:48.001335 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:48.001672 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:48.001674 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:48.001675 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:48.001755 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:48.002162 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:48.002164 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:48.002323 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.002469 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.002625 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"mutex_wait_us":3,"thread_start_us":110,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:54:48.003270 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:47.994026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:59921 (local address 127.2.191.126:38135)
0808 05:54:47.994203 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:47.994210 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:47.994509 (+ 299us) server_negotiation.cc:407] Connection header received
0808 05:54:47.994735 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:47.994738 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:47.994788 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:47.994878 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:47.995447 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.996177 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.997647 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:47.997895 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:47.997976 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:47.999416 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:47.999419 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:47.999421 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:47.999442 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:48.000999 (+ 1557us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.001488 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.001491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.001492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.001577 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.001844 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.001847 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.001848 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.002073 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:48.002159 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.002647 (+ 488us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.003087 (+ 440us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:54:48.020318 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:38135
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:48.136711 5112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:48.136993 5112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:48.137092 5112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:48.141217 5112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:48.141284 5112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:48.141324 5112 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:54:48.141338 5112 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:54:48.141433 5112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:54:48.148262 5112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:38135
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:48.149508 5112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:48.150652 5112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:48.160933 5121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:48.161051 5112 server_base.cc:1034] running on GCE node
W20260808 05:54:48.160933 5118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:48.161267 5119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:48.161679 5112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:48.162401 5112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:48.163627 5112 hybrid_clock.cc:648] HybridClock initialized: now 1786168488163601 us; error 35 us; skew 500 ppm
Aug 08 05:54:48 dist-test-slave-qg60 krb5kdc[4674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168488, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:48.166529 5112 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:54:48.167486 5112 webserver.cc:460] Webserver started at http://127.2.191.67:36205/ using document root <none> and password file <none>
I20260808 05:54:48.168110 5112 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:48.168212 5112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:48.168455 5112 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:48.170631 5112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "8642a667ec424f73b14437a2fb1c5e6f"
format_stamp: "Formatted at 2026-08-08 05:54:48 on dist-test-slave-qg60"
server_key: "b0931fd2580f40d57159be2e942a2373"
server_key_iv: "0c4f13e4320af46ec0f9fe683e00e391"
server_key_version: "encryptionkey@0"
I20260808 05:54:48.171236 5112 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "8642a667ec424f73b14437a2fb1c5e6f"
format_stamp: "Formatted at 2026-08-08 05:54:48 on dist-test-slave-qg60"
server_key: "b0931fd2580f40d57159be2e942a2373"
server_key_iv: "0c4f13e4320af46ec0f9fe683e00e391"
server_key_version: "encryptionkey@0"
I20260808 05:54:48.175510 5112 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 05:54:48.178254 5130 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:48.179611 5112 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:54:48.179774 5112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "8642a667ec424f73b14437a2fb1c5e6f"
format_stamp: "Formatted at 2026-08-08 05:54:48 on dist-test-slave-qg60"
server_key: "b0931fd2580f40d57159be2e942a2373"
server_key_iv: "0c4f13e4320af46ec0f9fe683e00e391"
server_key_version: "encryptionkey@0"
I20260808 05:54:48.179903 5112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:48.191274 5112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:48.194941 5112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:48.195182 5112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:48.196806 5112 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:48.196884 5112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:48.196967 5112 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:48.197028 5112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:54:48 dist-test-slave-qg60 krb5kdc[4674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168488, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:48.210309 5112 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:41881
I20260808 05:54:48.210886 5250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:41881 every 8 connection(s)
I20260808 05:54:48.211534 5112 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:54:48.213096 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.197827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:37467 (local address 127.2.191.126:38135)
0808 05:54:48.197960 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.197964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.199185 (+ 1221us) server_negotiation.cc:407] Connection header received
0808 05:54:48.200309 (+ 1124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.200313 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.200383 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.200451 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:48.202023 (+ 1572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.202716 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.204209 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.204482 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.204605 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.208143 (+ 3538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:48.208147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:48.208150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:48.208186 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:48.210166 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.210790 (+ 624us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.210794 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.210796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.210902 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.211321 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.211324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.211325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.211510 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:48.211596 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.212867 (+ 1271us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.212973 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:54:48.213593 5139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.198457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38135 (local address 127.2.191.67:37467)
0808 05:54:48.199001 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.199060 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.200032 (+ 972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.200954 (+ 922us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.200961 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.201361 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:48.201863 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.201877 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.202852 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.202856 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.204074 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.204084 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.204647 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.204651 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.204876 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.205593 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:48.205617 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:48.207960 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:48.210294 (+ 2334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:48.210300 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:48.210314 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:48.210673 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:48.211035 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:48.211038 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:48.211040 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:48.211225 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:48.211627 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:48.211633 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:48.211993 (+ 360us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.212234 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.212593 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":157,"threads_started":1}
I20260808 05:54:48.214980 5251 heartbeater.cc:347] Connected to a master server at 127.2.191.126:38135
I20260808 05:54:48.215174 5251 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:48.215731 5251 heartbeater.cc:511] Master 127.2.191.126:38135 requested a full tablet report, sending...
I20260808 05:54:48.216889 4727 ts_manager.cc:194] Registered new tserver with Master: 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881)
I20260808 05:54:48.217701 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 5112
I20260808 05:54:48.217754 4727 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:37467
I20260808 05:54:48.217845 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:54:48.218178 2813 external_mini_cluster.cc:1428] Setting key 9ab935f872256aff5b739404be000959
I20260808 05:54:48.220459 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:54:48.226691 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.217353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:59449 (local address 127.2.191.126:38135)
0808 05:54:48.217481 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.217485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.218747 (+ 1262us) server_negotiation.cc:407] Connection header received
0808 05:54:48.218932 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.218936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.218984 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.219090 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:48.219829 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.220418 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.221480 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.221889 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.222038 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.223154 (+ 1116us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:48.223157 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:48.223160 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:48.223191 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:48.224864 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.225352 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.225356 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.225358 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.225441 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.225765 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.225770 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.225771 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.226002 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:48.226118 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.226400 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.226519 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:54:48.226699 5258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.217233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38135 (local address 127.2.191.67:59449)
0808 05:54:48.218618 (+ 1385us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.218634 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.218772 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.219319 (+ 547us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.219322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.219586 (+ 264us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:48.219706 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.219713 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.220589 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.220592 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.221353 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.221363 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.222014 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.222016 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.222095 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.222648 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:48.222659 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:48.223000 (+ 341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:48.224979 (+ 1979us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:48.224983 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:48.224986 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:48.225243 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:48.225537 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:48.225541 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:48.225543 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:48.225643 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:48.226118 (+ 475us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:48.226121 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:48.226223 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.226330 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.226489 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1305,"thread_start_us":90,"threads_started":1}
Aug 08 05:54:48 dist-test-slave-qg60 krb5kdc[4674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:54:48 dist-test-slave-qg60 krb5kdc[4674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:48.251606 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.241937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38136 (local address 127.2.191.126:38135)
0808 05:54:48.242101 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.242104 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.242117 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:54:48.242162 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.242165 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.242205 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.242304 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:48.243130 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.243695 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.244569 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.244863 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.244973 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.247646 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:48.247650 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:48.247652 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:48.247687 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:48.249516 (+ 1829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.250119 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.250122 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.250123 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.250202 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.250491 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.250494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.250495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.250897 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:48.251017 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.251237 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.251365 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:54:48.255053 4727 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:54:48.258312 4727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:48.273049 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.266911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43528 (local address 127.2.191.65:33429)
0808 05:54:48.267589 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.267599 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.267637 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:54:48.267723 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.267731 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.267945 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.268115 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:48.268443 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.269725 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.271362 (+ 1637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.272240 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.272350 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.272496 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.272780 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.272895 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":555,"thread_start_us":66,"threads_started":1}
I20260808 05:54:48.273052 5270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.266755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33429 (local address 127.0.0.1:43528)
0808 05:54:48.267143 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.267203 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.267334 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.268097 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.268102 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.268156 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:48.268306 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.268314 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.269852 (+ 1538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.269855 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.271214 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.271225 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.272380 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.272384 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.272507 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.272565 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.272698 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.272880 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":1,"thread_start_us":96,"threads_started":1}
I20260808 05:54:48.273805 5272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.266967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41881 (local address 127.0.0.1:47754)
0808 05:54:48.268376 (+ 1409us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.268393 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.268479 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.269232 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.269235 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.269252 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:48.269361 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.269371 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.270657 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.270660 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.271830 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.271840 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.273088 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.273092 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.273446 (+ 354us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.273504 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.273584 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.273652 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1331,"mutex_wait_us":53,"spinlock_wait_cycles":2816,"thread_start_us":163,"threads_started":1}
I20260808 05:54:48.273932 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.267638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47754 (local address 127.2.191.67:41881)
0808 05:54:48.267988 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.268000 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.268600 (+ 600us) server_negotiation.cc:407] Connection header received
0808 05:54:48.268685 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.268691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.268937 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.269074 (+ 137us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:48.269500 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.270524 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.271972 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.272762 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.272863 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.273007 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.273647 (+ 640us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.273757 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":251,"thread_start_us":146,"threads_started":1}
I20260808 05:54:48.274116 5273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.267523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:33877 (local address 127.0.0.1:59652)
0808 05:54:48.268624 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.268637 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.268717 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.269267 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.269271 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.269302 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:48.269394 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.269399 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.270594 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.270598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.271776 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.271787 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.273458 (+ 1671us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.273461 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.273548 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.273606 (+ 58us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.273691 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.273763 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1042,"mutex_wait_us":29,"spinlock_wait_cycles":896,"thread_start_us":98,"threads_started":1}
I20260808 05:54:48.275370 5276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.267952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.2.191.66:33877)
0808 05:54:48.268329 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.268343 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.268842 (+ 499us) server_negotiation.cc:407] Connection header received
0808 05:54:48.268918 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.268939 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.269116 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.269260 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:48.269543 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.270449 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.271941 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.272717 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.272872 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.273072 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.275103 (+ 2031us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.275217 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":138,"threads_started":1}
I20260808 05:54:48.276271 4878 tablet_service.cc:1467] Processing CreateTablet for tablet 6ba1b7a75a1249f2b0c11485b65a799d (DEFAULT_TABLE table=test-table [id=9a6e9bdf26844cd3b5d6fa64ec2aae31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:48.276882 5182 tablet_service.cc:1467] Processing CreateTablet for tablet 6ba1b7a75a1249f2b0c11485b65a799d (DEFAULT_TABLE table=test-table [id=9a6e9bdf26844cd3b5d6fa64ec2aae31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:48.277523 4878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ba1b7a75a1249f2b0c11485b65a799d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.277936 5182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ba1b7a75a1249f2b0c11485b65a799d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.278002 5031 tablet_service.cc:1467] Processing CreateTablet for tablet 6ba1b7a75a1249f2b0c11485b65a799d (DEFAULT_TABLE table=test-table [id=9a6e9bdf26844cd3b5d6fa64ec2aae31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:48.279021 5031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6ba1b7a75a1249f2b0c11485b65a799d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.285279 5277 tablet_bootstrap.cc:492] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Bootstrap starting.
I20260808 05:54:48.286506 5278 tablet_bootstrap.cc:492] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Bootstrap starting.
I20260808 05:54:48.287177 5279 tablet_bootstrap.cc:492] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Bootstrap starting.
I20260808 05:54:48.288395 5277 tablet_bootstrap.cc:654] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.288422 5278 tablet_bootstrap.cc:654] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.289324 5278 log.cc:824] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:48.289577 5277 log.cc:824] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:48.290431 5279 tablet_bootstrap.cc:654] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.291290 5279 log.cc:824] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:48.291621 5278 tablet_bootstrap.cc:492] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: No bootstrap required, opened a new log
I20260808 05:54:48.291643 5277 tablet_bootstrap.cc:492] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: No bootstrap required, opened a new log
I20260808 05:54:48.291818 5277 ts_tablet_manager.cc:1397] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260808 05:54:48.291819 5278 ts_tablet_manager.cc:1397] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 05:54:48.293299 5279 tablet_bootstrap.cc:492] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: No bootstrap required, opened a new log
I20260808 05:54:48.293533 5279 ts_tablet_manager.cc:1397] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 05:54:48.296046 5277 raft_consensus.cc:348] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.296342 5277 raft_consensus.cc:374] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.296397 5277 raft_consensus.cc:729] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8642a667ec424f73b14437a2fb1c5e6f, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.296376 5278 raft_consensus.cc:348] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.296658 5278 raft_consensus.cc:374] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.296711 5278 raft_consensus.cc:729] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ac24136da54624a7c978e9c839f7d0, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.296952 5277 consensus_queue.cc:260] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.296885 5279 raft_consensus.cc:348] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.297160 5279 raft_consensus.cc:374] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.297222 5279 raft_consensus.cc:729] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11c856673ba4a6fbdf3bb17389fe4c4, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.297135 5278 consensus_queue.cc:260] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.297739 5279 consensus_queue.cc:260] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.297887 4950 heartbeater.cc:503] Master 127.2.191.126:38135 was elected leader, sending a full tablet report...
I20260808 05:54:48.298019 5277 ts_tablet_manager.cc:1428] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
I20260808 05:54:48.298594 5102 heartbeater.cc:503] Master 127.2.191.126:38135 was elected leader, sending a full tablet report...
I20260808 05:54:48.298621 5251 heartbeater.cc:503] Master 127.2.191.126:38135 was elected leader, sending a full tablet report...
I20260808 05:54:48.298790 5279 ts_tablet_manager.cc:1428] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260808 05:54:48.299960 5278 ts_tablet_manager.cc:1428] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260808 05:54:48.402798 5285 raft_consensus.cc:482] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:48.403010 5285 raft_consensus.cc:504] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.404299 5285 leader_election.cc:288] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881), f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877)
I20260808 05:54:48.408619 5274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.404897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:54497 (local address 127.2.191.67:41881)
0808 05:54:48.405026 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.405031 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.405275 (+ 244us) server_negotiation.cc:407] Connection header received
0808 05:54:48.405442 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.405445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.405498 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.405598 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:48.405902 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.406416 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.407584 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.407994 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.408136 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.408191 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.408408 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.408476 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:54:48.408646 5288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.404713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41881 (local address 127.2.191.65:54497)
0808 05:54:48.405156 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.405169 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.405313 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.405608 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.405611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.405640 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:48.405780 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.405785 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.406540 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.406544 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.407436 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.407446 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.408135 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.408138 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.408240 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.408295 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.408388 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.408466 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":27,"thread_start_us":119,"threads_started":1}
I20260808 05:54:48.408643 5276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.404759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:42789 (local address 127.2.191.66:33877)
0808 05:54:48.404927 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.404932 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.405229 (+ 297us) server_negotiation.cc:407] Connection header received
0808 05:54:48.405399 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.405409 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.405452 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.405559 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:48.405884 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.406416 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.407603 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.408009 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.408145 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.408200 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.408431 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.408504 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 05:54:48.408680 5287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.404604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:33877 (local address 127.2.191.65:42789)
0808 05:54:48.405118 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.405133 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.405276 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.405577 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.405580 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.405598 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:48.405762 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.405768 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.406543 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.406549 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.407468 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.407479 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.408139 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.408142 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.408305 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.408324 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.408413 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.408487 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"mutex_wait_us":87,"spinlock_wait_cycles":8064,"thread_start_us":184,"threads_started":1}
I20260808 05:54:48.409559 5054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ba1b7a75a1249f2b0c11485b65a799d" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" is_pre_election: true
I20260808 05:54:48.409602 5202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ba1b7a75a1249f2b0c11485b65a799d" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8642a667ec424f73b14437a2fb1c5e6f" is_pre_election: true
I20260808 05:54:48.409888 5054 raft_consensus.cc:2454] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 0.
I20260808 05:54:48.409899 5202 raft_consensus.cc:2454] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 0.
I20260808 05:54:48.410436 4827 leader_election.cc:302] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f11c856673ba4a6fbdf3bb17389fe4c4, f4ac24136da54624a7c978e9c839f7d0; no voters:
I20260808 05:54:48.410774 5285 raft_consensus.cc:2781] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:48.410869 5285 raft_consensus.cc:482] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:48.410915 5285 raft_consensus.cc:3037] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:48.412051 5285 raft_consensus.cc:504] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.412433 5285 leader_election.cc:288] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 election: Requested vote from peers 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881), f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877)
I20260808 05:54:48.412954 5202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ba1b7a75a1249f2b0c11485b65a799d" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8642a667ec424f73b14437a2fb1c5e6f"
I20260808 05:54:48.413123 5202 raft_consensus.cc:3037] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:48.414248 5202 raft_consensus.cc:2454] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 1.
I20260808 05:54:48.414523 5054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6ba1b7a75a1249f2b0c11485b65a799d" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4"
I20260808 05:54:48.414628 4824 leader_election.cc:302] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8642a667ec424f73b14437a2fb1c5e6f, f4ac24136da54624a7c978e9c839f7d0; no voters:
I20260808 05:54:48.414678 5054 raft_consensus.cc:3037] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:48.416271 5054 raft_consensus.cc:2454] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 1.
I20260808 05:54:48.416564 5285 raft_consensus.cc:2781] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:48.416865 5285 raft_consensus.cc:686] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 1 LEADER]: Becoming Leader. State: Replica: f4ac24136da54624a7c978e9c839f7d0, State: Running, Role: LEADER
I20260808 05:54:48.417291 5285 consensus_queue.cc:237] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } }
I20260808 05:54:48.420815 4727 catalog_manager.cc:5495] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } health_report { overall_health: UNKNOWN } } }
W20260808 05:54:48.462879 5253 tablet.cc:2369] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 05:54:48 dist-test-slave-qg60 krb5kdc[4674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168487, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:48.483197 5297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.474549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:38135 (local address 127.0.0.1:38140)
0808 05:54:48.474926 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.474940 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.475047 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.475300 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.475302 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.475740 (+ 438us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:48.475846 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.475853 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.476619 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.476622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.477273 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.477283 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.477710 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.477712 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.477774 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.478345 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:48.478357 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:48.479920 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:48.481522 (+ 1602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:48.481540 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:48.481546 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:48.481797 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:48.482070 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:48.482072 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:48.482073 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:48.482157 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:48.482636 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:48.482642 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:48.482752 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.482853 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.482988 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":197,"threads_started":1}
I20260808 05:54:48.483238 4782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.474653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38140 (local address 127.2.191.126:38135)
0808 05:54:48.474832 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.474838 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.475020 (+ 182us) server_negotiation.cc:407] Connection header received
0808 05:54:48.475141 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.475143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.475187 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.475260 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:48.475960 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.476485 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.477379 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.477607 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.477687 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.480065 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:48.480069 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:48.480071 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:48.480092 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:48.481398 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.481896 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.481899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.481900 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.481976 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:48.482244 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:48.482246 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:48.482247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:48.482493 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:48.482599 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.482910 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.483059 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":89}
W20260808 05:54:48.487578 5103 tablet.cc:2369] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:54:48.488001 4727 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:38140:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:54:48.488834 4727 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:48.494189 4878 tablet_service.cc:1467] Processing CreateTablet for tablet 056012d5ae5d43579e8f4f6801006b65 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=831a27abad8f4cd89af083da18322050]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:54:48.494168 5031 tablet_service.cc:1467] Processing CreateTablet for tablet 056012d5ae5d43579e8f4f6801006b65 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=831a27abad8f4cd89af083da18322050]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:54:48.494386 5182 tablet_service.cc:1467] Processing CreateTablet for tablet 056012d5ae5d43579e8f4f6801006b65 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=831a27abad8f4cd89af083da18322050]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:54:48.494989 5031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056012d5ae5d43579e8f4f6801006b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.494989 4878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056012d5ae5d43579e8f4f6801006b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.495023 5182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 056012d5ae5d43579e8f4f6801006b65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.497640 5277 tablet_bootstrap.cc:492] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: Bootstrap starting.
I20260808 05:54:48.498075 5278 tablet_bootstrap.cc:492] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: Bootstrap starting.
W20260808 05:54:48.498135 4951 tablet.cc:2369] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:54:48.498718 5277 tablet_bootstrap.cc:654] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.498879 5279 tablet_bootstrap.cc:492] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: Bootstrap starting.
I20260808 05:54:48.499773 5278 tablet_bootstrap.cc:654] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.499974 5279 tablet_bootstrap.cc:654] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.501430 5278 tablet_bootstrap.cc:492] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: No bootstrap required, opened a new log
I20260808 05:54:48.501587 5278 ts_tablet_manager.cc:1397] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 05:54:48.501744 5277 tablet_bootstrap.cc:492] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: No bootstrap required, opened a new log
I20260808 05:54:48.501868 5277 ts_tablet_manager.cc:1397] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260808 05:54:48.501915 5279 tablet_bootstrap.cc:492] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: No bootstrap required, opened a new log
I20260808 05:54:48.501992 5279 ts_tablet_manager.cc:1397] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:48.502194 5278 raft_consensus.cc:348] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.502321 5278 raft_consensus.cc:374] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.502357 5278 raft_consensus.cc:729] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ac24136da54624a7c978e9c839f7d0, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.502410 5277 raft_consensus.cc:348] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.502467 5279 raft_consensus.cc:348] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.502493 5278 consensus_queue.cc:260] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.502568 5277 raft_consensus.cc:374] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.502578 5279 raft_consensus.cc:374] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.502619 5279 raft_consensus.cc:729] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11c856673ba4a6fbdf3bb17389fe4c4, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.502616 5277 raft_consensus.cc:729] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8642a667ec424f73b14437a2fb1c5e6f, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.502733 5279 consensus_queue.cc:260] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.502735 5285 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.502851 5285 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:48.502761 5277 consensus_queue.cc:260] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.503007 5279 ts_tablet_manager.cc:1428] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:54:48.503098 5277 ts_tablet_manager.cc:1428] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s
I20260808 05:54:48.503208 5286 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.503350 5286 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:48.503398 5284 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.503520 5278 ts_tablet_manager.cc:1428] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:54:48.503561 5284 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:48.603854 5285 raft_consensus.cc:482] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:48.604005 5285 raft_consensus.cc:504] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.604393 5285 leader_election.cc:288] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877), 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881)
I20260808 05:54:48.604974 5202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056012d5ae5d43579e8f4f6801006b65" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8642a667ec424f73b14437a2fb1c5e6f" is_pre_election: true
I20260808 05:54:48.605031 5054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056012d5ae5d43579e8f4f6801006b65" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" is_pre_election: true
I20260808 05:54:48.605129 5202 raft_consensus.cc:2454] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 0.
I20260808 05:54:48.605279 5054 raft_consensus.cc:2454] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 0.
I20260808 05:54:48.605517 4824 leader_election.cc:302] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8642a667ec424f73b14437a2fb1c5e6f, f4ac24136da54624a7c978e9c839f7d0; no voters:
I20260808 05:54:48.605713 5285 raft_consensus.cc:2781] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:48.605789 5285 raft_consensus.cc:482] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:48.605842 5285 raft_consensus.cc:3037] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:48.607013 5285 raft_consensus.cc:504] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.607365 5285 leader_election.cc:288] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 election: Requested vote from peers f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877), 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881)
I20260808 05:54:48.607796 5054 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056012d5ae5d43579e8f4f6801006b65" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4"
I20260808 05:54:48.607826 5202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "056012d5ae5d43579e8f4f6801006b65" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8642a667ec424f73b14437a2fb1c5e6f"
I20260808 05:54:48.607936 5202 raft_consensus.cc:3037] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:48.607936 5054 raft_consensus.cc:3037] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:48.609208 5202 raft_consensus.cc:2454] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 1.
I20260808 05:54:48.609217 5054 raft_consensus.cc:2454] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 1.
I20260808 05:54:48.609534 4824 leader_election.cc:302] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8642a667ec424f73b14437a2fb1c5e6f, f4ac24136da54624a7c978e9c839f7d0; no voters:
I20260808 05:54:48.609730 5285 raft_consensus.cc:2781] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:48.609827 5285 raft_consensus.cc:686] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [term 1 LEADER]: Becoming Leader. State: Replica: f4ac24136da54624a7c978e9c839f7d0, State: Running, Role: LEADER
I20260808 05:54:48.610036 5285 consensus_queue.cc:237] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.610796 5289 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: TxnStatusTablet state changed. Reason: New leader f4ac24136da54624a7c978e9c839f7d0. Latest consensus state: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.610932 5289 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:54:48.611280 5302 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:54:48.611581 5302 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:54:48.612098 4726 catalog_manager.cc:5495] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } health_report { overall_health: UNKNOWN } } }
I20260808 05:54:48.631538 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.627337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43540 (local address 127.2.191.65:33429)
0808 05:54:48.627466 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.627469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.627522 (+ 53us) server_negotiation.cc:407] Connection header received
0808 05:54:48.627726 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.627728 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.627779 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.627861 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:48.628183 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.628694 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.630006 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.630234 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.630319 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.630657 (+ 338us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:48.631149 (+ 492us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:48.631242 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.631364 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.631419 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 05:54:48.631579 5297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.627215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33429 (local address 127.0.0.1:43540)
0808 05:54:48.627461 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.627476 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.627587 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.627901 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.627904 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.627912 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:54:48.628030 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.628045 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.628869 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.628872 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.629870 (+ 998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.629881 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.630346 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.630350 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.630443 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.630497 (+ 54us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:54:48.631250 (+ 753us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:54:48.631266 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.631340 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.631433 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144}
I20260808 05:54:48.638451 5202 raft_consensus.cc:1261] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Refusing update from remote peer f4ac24136da54624a7c978e9c839f7d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:48.638659 5054 raft_consensus.cc:1261] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Refusing update from remote peer f4ac24136da54624a7c978e9c839f7d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:48.639237 5285 consensus_queue.cc:1035] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:48.639421 5289 consensus_queue.cc:1035] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:48.644750 5286 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: TxnStatusTablet state changed. Reason: New leader f4ac24136da54624a7c978e9c839f7d0. Latest consensus state: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.644891 5286 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:48.644840 5284 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: TxnStatusTablet state changed. Reason: New leader f4ac24136da54624a7c978e9c839f7d0. Latest consensus state: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.644963 5284 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:48.648708 5289 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.648855 5289 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:54:48.649809 5286 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.649933 5286 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P f11c856673ba4a6fbdf3bb17389fe4c4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:48.652225 5284 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.652357 5284 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P 8642a667ec424f73b14437a2fb1c5e6f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:54:48.646494 5285 tablet_replica.cc:439] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } } }
I20260808 05:54:48.652595 5285 tablet_replica.cc:442] T 056012d5ae5d43579e8f4f6801006b65 P f4ac24136da54624a7c978e9c839f7d0: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:54:48.652999 5307 mvcc.cc:205] Tried to move back new op lower bound from 7316146129449799680 to 7316146129348079616. Current Snapshot: MvccSnapshot[applied={T|T < 7316146129449799680}]
I20260808 05:54:48.655020 5308 mvcc.cc:205] Tried to move back new op lower bound from 7316146129449799680 to 7316146129348079616. Current Snapshot: MvccSnapshot[applied={T|T < 7316146129449799680}]
I20260808 05:54:48.659637 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.656049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43554 (local address 127.2.191.65:33429)
0808 05:54:48.656164 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.656169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.656184 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:54:48.656234 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.656238 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.656295 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.656377 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:48.656892 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.657463 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.658406 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.658688 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.658854 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.659151 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:48.659234 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:48.659321 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.659429 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.659489 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:54:48.672081 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.668280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:48669 (local address 127.2.191.65:33429)
0808 05:54:48.668419 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:48.668424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:48.668636 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:54:48.668827 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:48.668830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:48.668900 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:48.669011 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:48.669310 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.669855 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.670854 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.671092 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.671218 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.671576 (+ 358us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:48.671654 (+ 78us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:48.671744 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:48.671847 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 05:54:48.671902 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":55}
I20260808 05:54:48.672091 5319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:48.668196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33429 (local address 127.2.191.65:48669)
0808 05:54:48.668536 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:48.668553 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:48.668663 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:48.669030 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:48.669033 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:48.669040 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:54:48.669182 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.669189 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.669979 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.669984 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.670707 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:48.670717 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:48.671239 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:48.671243 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:48.671357 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:48.671400 (+ 43us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:54:48.671750 (+ 350us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:54:48.671759 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 05:54:48.671828 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 05:54:48.671913 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":132,"threads_started":1}
I20260808 05:54:48.680073 5202 raft_consensus.cc:1261] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Refusing update from remote peer f4ac24136da54624a7c978e9c839f7d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:48.680168 5053 raft_consensus.cc:1261] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Refusing update from remote peer f4ac24136da54624a7c978e9c839f7d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:48.680661 5289 consensus_queue.cc:1035] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:48.680852 5285 consensus_queue.cc:1035] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:48.683805 5306 mvcc.cc:205] Tried to move back new op lower bound from 7316146129629736960 to 7316146128560599040. Current Snapshot: MvccSnapshot[applied={T|T < 7316146129629736960}]
I20260808 05:54:48.730770 4724 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:48.730989 4724 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:48.733887 4724 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: Sending DeleteTablet for 3 replicas of tablet 6ba1b7a75a1249f2b0c11485b65a799d
I20260808 05:54:48.734719 5182 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ba1b7a75a1249f2b0c11485b65a799d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:48 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:47754
I20260808 05:54:48.734743 5031 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ba1b7a75a1249f2b0c11485b65a799d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:48 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:59652
I20260808 05:54:48.735491 5325 tablet_replica.cc:330] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: stopping tablet replica
I20260808 05:54:48.735415 4878 tablet_service.cc:1514] Processing DeleteTablet for tablet 6ba1b7a75a1249f2b0c11485b65a799d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:48 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:43528
I20260808 05:54:48.735591 4724 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 05:54:48.735852 5325 raft_consensus.cc:2229] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 05:54:48.736025 4724 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:48.736053 5327 tablet_replica.cc:330] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: stopping tablet replica
I20260808 05:54:48.736129 5325 raft_consensus.cc:2258] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:48.736490 5328 tablet_replica.cc:330] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: stopping tablet replica
I20260808 05:54:48.736663 5327 raft_consensus.cc:2229] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:48.736790 5328 raft_consensus.cc:2229] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:54:48.736944 5327 raft_consensus.cc:2258] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:48.737169 5328 raft_consensus.cc:2258] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:48.738466 5327 ts_tablet_manager.cc:1905] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:48.738466 5325 ts_tablet_manager.cc:1905] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:48.740710 5328 ts_tablet_manager.cc:1905] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:48.741940 5325 ts_tablet_manager.cc:1918] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:48.742080 5325 log.cc:1196] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/6ba1b7a75a1249f2b0c11485b65a799d
I20260808 05:54:48.742142 4878 tablet_service.cc:1467] Processing CreateTablet for tablet bcb33f692bd748809fef017930c83fc1 (DEFAULT_TABLE table=test-table [id=b59a0e2bb3ad44c19918fb2da8b31f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:48.742565 5325 ts_tablet_manager.cc:1939] T 6ba1b7a75a1249f2b0c11485b65a799d P 8642a667ec424f73b14437a2fb1c5e6f: Deleting consensus metadata
I20260808 05:54:48.743804 5328 ts_tablet_manager.cc:1918] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:48.743911 5328 log.cc:1196] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/6ba1b7a75a1249f2b0c11485b65a799d
I20260808 05:54:48.744273 5328 ts_tablet_manager.cc:1939] T 6ba1b7a75a1249f2b0c11485b65a799d P f4ac24136da54624a7c978e9c839f7d0: Deleting consensus metadata
I20260808 05:54:48.746450 5327 ts_tablet_manager.cc:1918] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:48.746584 5327 log.cc:1196] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/6ba1b7a75a1249f2b0c11485b65a799d
I20260808 05:54:48.747164 5327 ts_tablet_manager.cc:1939] T 6ba1b7a75a1249f2b0c11485b65a799d P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting consensus metadata
I20260808 05:54:48.747479 5031 tablet_service.cc:1467] Processing CreateTablet for tablet bcb33f692bd748809fef017930c83fc1 (DEFAULT_TABLE table=test-table [id=b59a0e2bb3ad44c19918fb2da8b31f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:48.747776 5031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcb33f692bd748809fef017930c83fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.750403 5279 tablet_bootstrap.cc:492] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: Bootstrap starting.
I20260808 05:54:48.751533 5279 tablet_bootstrap.cc:654] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.752609 4710 catalog_manager.cc:4841] TS f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429): tablet 6ba1b7a75a1249f2b0c11485b65a799d (table test-table [id=9a6e9bdf26844cd3b5d6fa64ec2aae31]) successfully deleted
I20260808 05:54:48.752774 4878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcb33f692bd748809fef017930c83fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.752868 4710 catalog_manager.cc:4841] TS f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877): tablet 6ba1b7a75a1249f2b0c11485b65a799d (table test-table [id=9a6e9bdf26844cd3b5d6fa64ec2aae31]) successfully deleted
I20260808 05:54:48.753464 5279 tablet_bootstrap.cc:492] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: No bootstrap required, opened a new log
I20260808 05:54:48.753561 5279 ts_tablet_manager.cc:1397] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:48.754053 5279 raft_consensus.cc:348] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.754189 5279 raft_consensus.cc:374] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.754235 5279 raft_consensus.cc:729] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11c856673ba4a6fbdf3bb17389fe4c4, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.754380 5279 consensus_queue.cc:260] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.755697 4706 catalog_manager.cc:4841] TS 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881): tablet 6ba1b7a75a1249f2b0c11485b65a799d (table test-table [id=9a6e9bdf26844cd3b5d6fa64ec2aae31]) successfully deleted
I20260808 05:54:48.756202 5278 tablet_bootstrap.cc:492] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: Bootstrap starting.
I20260808 05:54:48.756826 5182 tablet_service.cc:1467] Processing CreateTablet for tablet bcb33f692bd748809fef017930c83fc1 (DEFAULT_TABLE table=test-table [id=b59a0e2bb3ad44c19918fb2da8b31f86]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:48.757138 5182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bcb33f692bd748809fef017930c83fc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:48.757282 5278 tablet_bootstrap.cc:654] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.758827 5279 ts_tablet_manager.cc:1428] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s
I20260808 05:54:48.759716 5278 tablet_bootstrap.cc:492] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: No bootstrap required, opened a new log
I20260808 05:54:48.759810 5278 ts_tablet_manager.cc:1397] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 05:54:48.760288 5278 raft_consensus.cc:348] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.760426 5278 raft_consensus.cc:374] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.760473 5278 raft_consensus.cc:729] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ac24136da54624a7c978e9c839f7d0, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.760660 5278 consensus_queue.cc:260] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.760990 5278 ts_tablet_manager.cc:1428] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:54:48.761591 5277 tablet_bootstrap.cc:492] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: Bootstrap starting.
I20260808 05:54:48.762637 5277 tablet_bootstrap.cc:654] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:48.763935 5277 tablet_bootstrap.cc:492] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: No bootstrap required, opened a new log
I20260808 05:54:48.764115 5277 ts_tablet_manager.cc:1397] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 05:54:48.764570 5277 raft_consensus.cc:348] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.764704 5277 raft_consensus.cc:374] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:48.764750 5277 raft_consensus.cc:729] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8642a667ec424f73b14437a2fb1c5e6f, State: Initialized, Role: FOLLOWER
I20260808 05:54:48.764926 5277 consensus_queue.cc:260] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:48.765249 5277 ts_tablet_manager.cc:1428] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: Time spent starting tablet: real 0.001s user 0.000s sys 0.002s
I20260808 05:54:49.041113 5284 raft_consensus.cc:482] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:49.041272 5284 raft_consensus.cc:504] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:49.042557 5284 leader_election.cc:288] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429), f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877)
I20260808 05:54:49.047214 5334 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.043509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:36413 (local address 127.2.191.66:33877)
0808 05:54:49.043813 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:49.043818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:49.043831 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:54:49.043880 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:49.043883 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:49.043927 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:49.044022 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:49.044335 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.044885 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.046043 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.046516 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.046625 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.046699 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:49.046969 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 05:54:49.047058 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":221,"thread_start_us":91,"threads_started":1}
I20260808 05:54:49.047436 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.042967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:35783 (local address 127.2.191.65:33429)
0808 05:54:49.043127 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:49.043132 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:49.043355 (+ 223us) server_negotiation.cc:407] Connection header received
0808 05:54:49.043554 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:49.043558 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:49.043608 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:49.043676 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:49.044125 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.044798 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.046143 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.046610 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.046753 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.046813 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:49.047124 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 05:54:49.047293 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:54:49.047500 5332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.042876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33429 (local address 127.2.191.67:35783)
0808 05:54:49.043225 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:49.043240 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:49.043408 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:49.043841 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:49.043845 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:49.043865 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:49.043981 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:49.043990 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.044925 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.044931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:49.045926 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:49.046000 (+ 74us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.046781 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.046784 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:49.046870 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.046888 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 05:54:49.047102 (+ 214us) client_negotiation.cc:240] Negotiation successful
0808 05:54:49.047176 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277,"mutex_wait_us":113,"thread_start_us":167,"threads_started":1}
I20260808 05:54:49.047227 5333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.043363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:33877 (local address 127.2.191.67:36413)
0808 05:54:49.043606 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:49.043627 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:49.043709 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:49.044059 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:49.044064 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:49.044084 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:49.044213 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:49.044220 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.045005 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.045008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:49.045878 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:49.045888 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.046658 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.046664 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:49.046810 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.046845 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 05:54:49.046921 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:54:49.047027 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":25,"thread_start_us":85,"threads_started":1}
I20260808 05:54:49.048175 5053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcb33f692bd748809fef017930c83fc1" candidate_uuid: "8642a667ec424f73b14437a2fb1c5e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" is_pre_election: true
I20260808 05:54:49.048225 4902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcb33f692bd748809fef017930c83fc1" candidate_uuid: "8642a667ec424f73b14437a2fb1c5e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ac24136da54624a7c978e9c839f7d0" is_pre_election: true
I20260808 05:54:49.048385 5053 raft_consensus.cc:2454] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8642a667ec424f73b14437a2fb1c5e6f in term 0.
I20260808 05:54:49.048484 4902 raft_consensus.cc:2454] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8642a667ec424f73b14437a2fb1c5e6f in term 0.
I20260808 05:54:49.048832 5134 leader_election.cc:302] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8642a667ec424f73b14437a2fb1c5e6f, f11c856673ba4a6fbdf3bb17389fe4c4; no voters:
I20260808 05:54:49.049149 5284 raft_consensus.cc:2781] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:49.049230 5284 raft_consensus.cc:482] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:49.049270 5284 raft_consensus.cc:3037] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:49.050318 5284 raft_consensus.cc:504] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:49.050680 5284 leader_election.cc:288] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [CANDIDATE]: Term 1 election: Requested vote from peers f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429), f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877)
I20260808 05:54:49.051085 4902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcb33f692bd748809fef017930c83fc1" candidate_uuid: "8642a667ec424f73b14437a2fb1c5e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ac24136da54624a7c978e9c839f7d0"
I20260808 05:54:49.051115 5053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcb33f692bd748809fef017930c83fc1" candidate_uuid: "8642a667ec424f73b14437a2fb1c5e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4"
I20260808 05:54:49.051224 4902 raft_consensus.cc:3037] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:49.051249 5053 raft_consensus.cc:3037] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:49.052286 5053 raft_consensus.cc:2454] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8642a667ec424f73b14437a2fb1c5e6f in term 1.
I20260808 05:54:49.052356 4902 raft_consensus.cc:2454] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8642a667ec424f73b14437a2fb1c5e6f in term 1.
I20260808 05:54:49.052764 5134 leader_election.cc:302] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8642a667ec424f73b14437a2fb1c5e6f, f4ac24136da54624a7c978e9c839f7d0; no voters:
I20260808 05:54:49.052970 5284 raft_consensus.cc:2781] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:49.053182 5284 raft_consensus.cc:686] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 LEADER]: Becoming Leader. State: Replica: 8642a667ec424f73b14437a2fb1c5e6f, State: Running, Role: LEADER
I20260808 05:54:49.053449 5284 consensus_queue.cc:237] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:49.055940 4724 catalog_manager.cc:5495] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67). New cstate: current_term: 1 leader_uuid: "8642a667ec424f73b14437a2fb1c5e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } health_report { overall_health: HEALTHY } } }
I20260808 05:54:49.139623 5338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.135853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47766 (local address 127.2.191.67:41881)
0808 05:54:49.136120 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:49.136127 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:49.136139 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:54:49.136209 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:49.136211 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:49.136270 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:49.136382 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:49.136637 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.137235 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.138148 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.138374 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.138457 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.138759 (+ 302us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:49.139225 (+ 466us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:49.139315 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:49.139412 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 05:54:49.139479 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":125,"threads_started":1}
I20260808 05:54:49.152046 5271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.146859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:47849 (local address 127.2.191.65:33429)
0808 05:54:49.147007 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:49.147012 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:49.147218 (+ 206us) server_negotiation.cc:407] Connection header received
0808 05:54:49.147277 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:49.147279 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:49.147326 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:49.147401 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:49.147801 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.148550 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.150608 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.150986 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.151144 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.151636 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:49.151725 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:49.151791 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:49.151878 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 05:54:49.151926 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:54:49.152170 5343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.146750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33429 (local address 127.2.191.67:47849)
0808 05:54:49.147098 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:49.147112 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:49.147208 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:49.147434 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:49.147440 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:49.147447 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:54:49.147630 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:49.147640 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.148676 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.148680 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:49.150421 (+ 1741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:49.150433 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.151269 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.151275 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:49.151355 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.151429 (+ 74us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:54:49.151810 (+ 381us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:54:49.151815 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:54:49.151863 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:54:49.151927 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":125,"threads_started":1}
I20260808 05:54:49.158891 5053 raft_consensus.cc:1261] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Refusing update from remote peer 8642a667ec424f73b14437a2fb1c5e6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:49.159055 4902 raft_consensus.cc:1261] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Refusing update from remote peer 8642a667ec424f73b14437a2fb1c5e6f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:49.159439 5284 consensus_queue.cc:1035] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:49.159654 5335 consensus_queue.cc:1035] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:49.179468 5338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.175411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:47393 (local address 127.2.191.67:41881)
0808 05:54:49.175523 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:49.175532 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:49.175779 (+ 247us) server_negotiation.cc:407] Connection header received
0808 05:54:49.175893 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:49.175899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:49.175956 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:49.176037 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:49.176299 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.176895 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.178092 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.178410 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.178521 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.178877 (+ 356us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:49.178970 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:49.179071 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:49.179250 (+ 179us) server_negotiation.cc:299] Negotiation successful
0808 05:54:49.179315 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:54:49.179471 5349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:49.175354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41881 (local address 127.2.191.65:47393)
0808 05:54:49.175680 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:49.175697 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:49.175805 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:49.176064 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:49.176067 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:49.176075 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:54:49.176191 (+ 116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:49.176197 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.177005 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.177009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:49.177953 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:49.177966 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:49.178590 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:49.178595 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:49.178692 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:49.178730 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:54:49.179082 (+ 352us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:54:49.179092 (+ 10us) client_negotiation.cc:769] Sending connection context
0808 05:54:49.179217 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 05:54:49.179318 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":83,"threads_started":1}
W20260808 05:54:49.180259 5307 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 05:54:50.748180 4726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:50.748406 4726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:50.753321 4726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: Sending DeleteTablet for 3 replicas of tablet bcb33f692bd748809fef017930c83fc1
I20260808 05:54:50.754211 4878 tablet_service.cc:1514] Processing DeleteTablet for tablet bcb33f692bd748809fef017930c83fc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:50 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:43528
I20260808 05:54:50.754329 5031 tablet_service.cc:1514] Processing DeleteTablet for tablet bcb33f692bd748809fef017930c83fc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:50 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:59652
I20260808 05:54:50.754676 5381 tablet_replica.cc:330] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: stopping tablet replica
I20260808 05:54:50.754662 5182 tablet_service.cc:1514] Processing DeleteTablet for tablet bcb33f692bd748809fef017930c83fc1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:50 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:47754
I20260808 05:54:50.754815 5381 raft_consensus.cc:2229] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:50.754949 5381 raft_consensus.cc:2258] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:50.755111 5382 tablet_replica.cc:330] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: stopping tablet replica
I20260808 05:54:50.755285 5382 raft_consensus.cc:2229] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:54:50.755632 5382 raft_consensus.cc:2258] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:50.755721 5381 ts_tablet_manager.cc:1905] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:50.756338 5382 ts_tablet_manager.cc:1905] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:50.758985 5381 ts_tablet_manager.cc:1918] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:54:50.759069 5381 log.cc:1196] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/bcb33f692bd748809fef017930c83fc1
I20260808 05:54:50.759394 5381 ts_tablet_manager.cc:1939] T bcb33f692bd748809fef017930c83fc1 P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting consensus metadata
I20260808 05:54:50.759529 5382 ts_tablet_manager.cc:1918] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:54:50.759636 5382 log.cc:1196] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/bcb33f692bd748809fef017930c83fc1
I20260808 05:54:50.760054 5382 ts_tablet_manager.cc:1939] T bcb33f692bd748809fef017930c83fc1 P 8642a667ec424f73b14437a2fb1c5e6f: Deleting consensus metadata
I20260808 05:54:50.760489 4710 catalog_manager.cc:4841] TS f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877): tablet bcb33f692bd748809fef017930c83fc1 (table test-table [id=b59a0e2bb3ad44c19918fb2da8b31f86]) successfully deleted
I20260808 05:54:50.761229 4706 catalog_manager.cc:4841] TS 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881): tablet bcb33f692bd748809fef017930c83fc1 (table test-table [id=b59a0e2bb3ad44c19918fb2da8b31f86]) successfully deleted
I20260808 05:54:50.762727 5379 tablet_replica.cc:330] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: stopping tablet replica
I20260808 05:54:50.762912 5379 raft_consensus.cc:2229] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:50.763079 5379 raft_consensus.cc:2258] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:50.763716 5379 ts_tablet_manager.cc:1905] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:50.766767 5379 ts_tablet_manager.cc:1918] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:54:50.766882 5379 log.cc:1196] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/bcb33f692bd748809fef017930c83fc1
I20260808 05:54:50.767198 5379 ts_tablet_manager.cc:1939] T bcb33f692bd748809fef017930c83fc1 P f4ac24136da54624a7c978e9c839f7d0: Deleting consensus metadata
I20260808 05:54:50.768142 4710 catalog_manager.cc:4841] TS f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429): tablet bcb33f692bd748809fef017930c83fc1 (table test-table [id=b59a0e2bb3ad44c19918fb2da8b31f86]) successfully deleted
Aug 08 05:54:50 dist-test-slave-qg60 krb5kdc[4674](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168490, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:54:50 dist-test-slave-qg60 krb5kdc[4674](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168490, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:50.793931 5390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.780836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38148 (local address 127.2.191.126:38135)
0808 05:54:50.781153 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:50.781160 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:50.781177 (+ 17us) server_negotiation.cc:407] Connection header received
0808 05:54:50.781290 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:50.781293 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:50.781339 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:50.781420 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:50.782122 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.782675 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.783592 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.783814 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.783925 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.789992 (+ 6067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:50.789997 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:50.790001 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:50.790036 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:50.791958 (+ 1922us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:50.792499 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:50.792502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:50.792504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:50.792697 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:50.793056 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:50.793059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:50.793060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:50.793267 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:50.793377 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:50.793674 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 05:54:50.793788 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":106,"threads_started":1}
I20260808 05:54:50.796998 4726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:54:50.797520 4726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:50.802878 4878 tablet_service.cc:1467] Processing CreateTablet for tablet 243161297af74bbc91c04b6bdb9f84a2 (DEFAULT_TABLE table=test-table [id=ef2cfb586a524be0bd598c8a6ed5317b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:50.802934 5031 tablet_service.cc:1467] Processing CreateTablet for tablet 243161297af74bbc91c04b6bdb9f84a2 (DEFAULT_TABLE table=test-table [id=ef2cfb586a524be0bd598c8a6ed5317b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:50.803001 5182 tablet_service.cc:1467] Processing CreateTablet for tablet 243161297af74bbc91c04b6bdb9f84a2 (DEFAULT_TABLE table=test-table [id=ef2cfb586a524be0bd598c8a6ed5317b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:50.803254 4878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243161297af74bbc91c04b6bdb9f84a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:50.803268 5031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243161297af74bbc91c04b6bdb9f84a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:50.803303 5182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 243161297af74bbc91c04b6bdb9f84a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:50.806005 5392 tablet_bootstrap.cc:492] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: Bootstrap starting.
I20260808 05:54:50.806989 5392 tablet_bootstrap.cc:654] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:50.807639 5393 tablet_bootstrap.cc:492] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: Bootstrap starting.
I20260808 05:54:50.808588 5393 tablet_bootstrap.cc:654] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:50.808775 5392 tablet_bootstrap.cc:492] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: No bootstrap required, opened a new log
I20260808 05:54:50.808880 5392 ts_tablet_manager.cc:1397] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:50.808945 5391 tablet_bootstrap.cc:492] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: Bootstrap starting.
I20260808 05:54:50.809409 5392 raft_consensus.cc:348] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.809540 5392 raft_consensus.cc:374] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:50.809582 5392 raft_consensus.cc:729] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8642a667ec424f73b14437a2fb1c5e6f, State: Initialized, Role: FOLLOWER
I20260808 05:54:50.809767 5392 consensus_queue.cc:260] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.810177 5392 ts_tablet_manager.cc:1428] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:54:50.810230 5393 tablet_bootstrap.cc:492] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: No bootstrap required, opened a new log
I20260808 05:54:50.810249 5391 tablet_bootstrap.cc:654] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:50.810309 5393 ts_tablet_manager.cc:1397] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 05:54:50.810796 5393 raft_consensus.cc:348] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.810912 5393 raft_consensus.cc:374] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:50.810943 5393 raft_consensus.cc:729] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11c856673ba4a6fbdf3bb17389fe4c4, State: Initialized, Role: FOLLOWER
I20260808 05:54:50.811089 5393 consensus_queue.cc:260] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.811554 5393 ts_tablet_manager.cc:1428] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:54:50.812062 5391 tablet_bootstrap.cc:492] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: No bootstrap required, opened a new log
I20260808 05:54:50.812216 5391 ts_tablet_manager.cc:1397] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:50.812747 5391 raft_consensus.cc:348] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.812885 5391 raft_consensus.cc:374] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:50.812930 5391 raft_consensus.cc:729] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ac24136da54624a7c978e9c839f7d0, State: Initialized, Role: FOLLOWER
I20260808 05:54:50.813058 5391 consensus_queue.cc:260] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.813349 5391 ts_tablet_manager.cc:1428] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:54:50.813795 5397 raft_consensus.cc:482] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:50.813908 5397 raft_consensus.cc:504] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.815495 5397 leader_election.cc:288] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429), 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881)
I20260808 05:54:50.820897 5400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.816104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:51891 (local address 127.2.191.65:33429)
0808 05:54:50.816420 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:50.816430 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:50.816443 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:54:50.816485 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:50.816491 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:50.816531 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:50.816642 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:50.816930 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.817775 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.819399 (+ 1624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.820054 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.820177 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.820228 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:50.820664 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 05:54:50.820765 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":246,"thread_start_us":177,"threads_started":1}
I20260808 05:54:50.820897 5401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.816143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:54375 (local address 127.2.191.67:41881)
0808 05:54:50.816484 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:50.816493 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:50.816657 (+ 164us) server_negotiation.cc:407] Connection header received
0808 05:54:50.816768 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:50.816771 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:50.816822 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:50.816932 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:54:50.817175 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.817922 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.819399 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.820043 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.820176 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.820228 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:50.820640 (+ 412us) server_negotiation.cc:299] Negotiation successful
0808 05:54:50.820720 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":119,"threads_started":1}
I20260808 05:54:50.820991 5398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.815723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41881 (local address 127.2.191.66:54375)
0808 05:54:50.816534 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:50.816546 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:50.816664 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:50.816953 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:50.816955 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:50.816972 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:50.817071 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:50.817075 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.818066 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.818069 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:50.819265 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:50.819277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.820218 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.820225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:50.820455 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.820512 (+ 57us) client_negotiation.cc:769] Sending connection context
0808 05:54:50.820610 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 05:54:50.820785 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"mutex_wait_us":162,"thread_start_us":127,"threads_started":1}
I20260808 05:54:50.821502 5399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.815681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33429 (local address 127.2.191.66:51891)
0808 05:54:50.816171 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:50.816188 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:50.816291 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:50.816652 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:50.816655 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:50.816669 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:54:50.816831 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:50.816837 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.817881 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.817883 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:50.819265 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:50.819277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.820240 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.820244 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:50.820439 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.820512 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 05:54:50.820610 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 05:54:50.820792 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":123,"thread_start_us":143,"threads_started":1}
I20260808 05:54:50.821532 5202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243161297af74bbc91c04b6bdb9f84a2" candidate_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8642a667ec424f73b14437a2fb1c5e6f" is_pre_election: true
I20260808 05:54:50.821691 5202 raft_consensus.cc:2454] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f11c856673ba4a6fbdf3bb17389fe4c4 in term 0.
I20260808 05:54:50.821990 4902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243161297af74bbc91c04b6bdb9f84a2" candidate_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ac24136da54624a7c978e9c839f7d0" is_pre_election: true
I20260808 05:54:50.822161 4902 raft_consensus.cc:2454] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f11c856673ba4a6fbdf3bb17389fe4c4 in term 0.
I20260808 05:54:50.822131 4977 leader_election.cc:302] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8642a667ec424f73b14437a2fb1c5e6f, f11c856673ba4a6fbdf3bb17389fe4c4; no voters:
I20260808 05:54:50.822450 5397 raft_consensus.cc:2781] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:50.822515 5397 raft_consensus.cc:482] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:50.822553 5397 raft_consensus.cc:3037] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:50.823845 5397 raft_consensus.cc:504] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.824193 5397 leader_election.cc:288] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [CANDIDATE]: Term 1 election: Requested vote from peers f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429), 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881)
I20260808 05:54:50.824537 4902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243161297af74bbc91c04b6bdb9f84a2" candidate_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4ac24136da54624a7c978e9c839f7d0"
I20260808 05:54:50.824548 5202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "243161297af74bbc91c04b6bdb9f84a2" candidate_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8642a667ec424f73b14437a2fb1c5e6f"
I20260808 05:54:50.824676 4902 raft_consensus.cc:3037] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:50.824674 5202 raft_consensus.cc:3037] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:50.825812 5202 raft_consensus.cc:2454] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f11c856673ba4a6fbdf3bb17389fe4c4 in term 1.
I20260808 05:54:50.825812 4902 raft_consensus.cc:2454] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f11c856673ba4a6fbdf3bb17389fe4c4 in term 1.
I20260808 05:54:50.826087 4977 leader_election.cc:302] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8642a667ec424f73b14437a2fb1c5e6f, f11c856673ba4a6fbdf3bb17389fe4c4; no voters:
I20260808 05:54:50.826319 5397 raft_consensus.cc:2781] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:50.826566 5397 raft_consensus.cc:686] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 LEADER]: Becoming Leader. State: Replica: f11c856673ba4a6fbdf3bb17389fe4c4, State: Running, Role: LEADER
I20260808 05:54:50.826858 5397 consensus_queue.cc:237] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.829521 4726 catalog_manager.cc:5495] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66). New cstate: current_term: 1 leader_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } health_report { overall_health: UNKNOWN } } }
I20260808 05:54:50.850420 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.846348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59666 (local address 127.2.191.66:33877)
0808 05:54:50.846689 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:50.846696 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:50.846707 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:54:50.846781 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:50.846784 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:50.846836 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:50.846975 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:50.847293 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.847841 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.848842 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.849101 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.849222 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.849515 (+ 293us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:50.849979 (+ 464us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:50.850113 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:50.850157 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 05:54:50.850236 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":119,"threads_started":1}
I20260808 05:54:50.861513 5400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.858273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:32941 (local address 127.2.191.65:33429)
0808 05:54:50.858542 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:50.858545 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:50.858558 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:54:50.858606 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:50.858608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:50.858653 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:50.858718 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:50.858975 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.859603 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.860447 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.860672 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.860813 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.861110 (+ 297us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:50.861184 (+ 74us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:50.861241 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:50.861352 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 05:54:50.861402 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187}
I20260808 05:54:50.861522 5408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.857897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33429 (local address 127.2.191.66:32941)
0808 05:54:50.858247 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:50.858262 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:50.858379 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:50.858747 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:50.858749 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:50.858757 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:54:50.858877 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:50.858882 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.859709 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.859712 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:50.860342 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:50.860350 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.860817 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.860820 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:50.860892 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.860938 (+ 46us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:54:50.861265 (+ 327us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:54:50.861270 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:54:50.861322 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:54:50.861389 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":98,"threads_started":1}
I20260808 05:54:50.867882 4902 raft_consensus.cc:1261] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Refusing update from remote peer f11c856673ba4a6fbdf3bb17389fe4c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:50.867893 5202 raft_consensus.cc:1261] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Refusing update from remote peer f11c856673ba4a6fbdf3bb17389fe4c4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:50.868392 5402 consensus_queue.cc:1035] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:50.868642 5397 consensus_queue.cc:1035] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:50.888432 5405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.884864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:58785 (local address 127.2.191.66:33877)
0808 05:54:50.885006 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:50.885011 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:50.885358 (+ 347us) server_negotiation.cc:407] Connection header received
0808 05:54:50.885458 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:50.885460 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:50.885503 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:50.885565 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:50.885789 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.886297 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.887266 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.887581 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.887706 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.887960 (+ 254us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:50.888065 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:50.888143 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:50.888233 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 05:54:50.888285 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:54:50.888441 5414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:50.884805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:33877 (local address 127.2.191.65:58785)
0808 05:54:50.885290 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:50.885303 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:50.885392 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:50.885604 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:50.885606 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:50.885611 (+ 5us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:54:50.885717 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:50.885721 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.886383 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.886385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:50.887143 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:50.887153 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:50.887702 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:50.887706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:50.887802 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:50.887839 (+ 37us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:54:50.888147 (+ 308us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:54:50.888156 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 05:54:50.888224 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:54:50.888313 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":388,"thread_start_us":141,"threads_started":1}
I20260808 05:54:50.910982 4726 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:50.911254 4726 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:50.913764 4726 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: Sending DeleteTablet for 3 replicas of tablet 243161297af74bbc91c04b6bdb9f84a2
I20260808 05:54:50.914412 4878 tablet_service.cc:1514] Processing DeleteTablet for tablet 243161297af74bbc91c04b6bdb9f84a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:50 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:43528
I20260808 05:54:50.914633 5379 tablet_replica.cc:330] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: stopping tablet replica
I20260808 05:54:50.914609 5182 tablet_service.cc:1514] Processing DeleteTablet for tablet 243161297af74bbc91c04b6bdb9f84a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:50 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:47754
I20260808 05:54:50.914768 5379 raft_consensus.cc:2229] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:50.914846 5382 tablet_replica.cc:330] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: stopping tablet replica
I20260808 05:54:50.914894 5379 raft_consensus.cc:2258] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:50.914985 5382 raft_consensus.cc:2229] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:50.915114 5382 raft_consensus.cc:2258] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:50.915141 5031 tablet_service.cc:1514] Processing DeleteTablet for tablet 243161297af74bbc91c04b6bdb9f84a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:50 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:59652
I20260808 05:54:50.915349 5381 tablet_replica.cc:330] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: stopping tablet replica
I20260808 05:54:50.915459 5381 raft_consensus.cc:2229] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:54:50.915802 5381 raft_consensus.cc:2258] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:50.916026 5382 ts_tablet_manager.cc:1905] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:50.916002 5379 ts_tablet_manager.cc:1905] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:50.917623 5381 ts_tablet_manager.cc:1905] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:50.918772 5379 ts_tablet_manager.cc:1918] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:50.918771 5382 ts_tablet_manager.cc:1918] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:50.918845 5379 log.cc:1196] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/243161297af74bbc91c04b6bdb9f84a2
I20260808 05:54:50.918845 5382 log.cc:1196] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/243161297af74bbc91c04b6bdb9f84a2
I20260808 05:54:50.919121 5382 ts_tablet_manager.cc:1939] T 243161297af74bbc91c04b6bdb9f84a2 P 8642a667ec424f73b14437a2fb1c5e6f: Deleting consensus metadata
I20260808 05:54:50.919124 5379 ts_tablet_manager.cc:1939] T 243161297af74bbc91c04b6bdb9f84a2 P f4ac24136da54624a7c978e9c839f7d0: Deleting consensus metadata
I20260808 05:54:50.920151 4706 catalog_manager.cc:4841] TS 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881): tablet 243161297af74bbc91c04b6bdb9f84a2 (table test-table [id=ef2cfb586a524be0bd598c8a6ed5317b]) successfully deleted
I20260808 05:54:50.920411 5381 ts_tablet_manager.cc:1918] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:54:50.920480 5381 log.cc:1196] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/243161297af74bbc91c04b6bdb9f84a2
I20260808 05:54:50.920687 4710 catalog_manager.cc:4841] TS f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429): tablet 243161297af74bbc91c04b6bdb9f84a2 (table test-table [id=ef2cfb586a524be0bd598c8a6ed5317b]) successfully deleted
I20260808 05:54:50.920809 5381 ts_tablet_manager.cc:1939] T 243161297af74bbc91c04b6bdb9f84a2 P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting consensus metadata
I20260808 05:54:50.920763 4726 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38148:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:54:50.921188 4726 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:54:50.921800 4710 catalog_manager.cc:4841] TS f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877): tablet 243161297af74bbc91c04b6bdb9f84a2 (table test-table [id=ef2cfb586a524be0bd598c8a6ed5317b]) successfully deleted
I20260808 05:54:50.926206 5031 tablet_service.cc:1467] Processing CreateTablet for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c (DEFAULT_TABLE table=test-table [id=4b1bfcb315ff4d4cbc445eb5aef6569d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:50.926395 5182 tablet_service.cc:1467] Processing CreateTablet for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c (DEFAULT_TABLE table=test-table [id=4b1bfcb315ff4d4cbc445eb5aef6569d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:50.926508 5031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:50.926688 5182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:50.928808 5392 tablet_bootstrap.cc:492] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: Bootstrap starting.
I20260808 05:54:50.929114 5393 tablet_bootstrap.cc:492] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: Bootstrap starting.
I20260808 05:54:50.929469 4878 tablet_service.cc:1467] Processing CreateTablet for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c (DEFAULT_TABLE table=test-table [id=4b1bfcb315ff4d4cbc445eb5aef6569d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:54:50.929737 5392 tablet_bootstrap.cc:654] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:50.929761 4878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:50.930371 5393 tablet_bootstrap.cc:654] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:50.932057 5393 tablet_bootstrap.cc:492] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: No bootstrap required, opened a new log
I20260808 05:54:50.932147 5393 ts_tablet_manager.cc:1397] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:54:50.932271 5391 tablet_bootstrap.cc:492] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0: Bootstrap starting.
I20260808 05:54:50.932708 5393 raft_consensus.cc:348] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.932848 5393 raft_consensus.cc:374] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:50.932880 5393 raft_consensus.cc:729] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11c856673ba4a6fbdf3bb17389fe4c4, State: Initialized, Role: FOLLOWER
I20260808 05:54:50.933001 5393 consensus_queue.cc:260] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.933209 5391 tablet_bootstrap.cc:654] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:50.933245 5393 ts_tablet_manager.cc:1428] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:54:50.934082 5392 tablet_bootstrap.cc:492] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: No bootstrap required, opened a new log
I20260808 05:54:50.934187 5392 ts_tablet_manager.cc:1397] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 05:54:50.934672 5392 raft_consensus.cc:348] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.934803 5392 raft_consensus.cc:374] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:50.934850 5392 raft_consensus.cc:729] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8642a667ec424f73b14437a2fb1c5e6f, State: Initialized, Role: FOLLOWER
I20260808 05:54:50.934989 5392 consensus_queue.cc:260] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.935289 5392 ts_tablet_manager.cc:1428] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:54:50.936839 5391 tablet_bootstrap.cc:492] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0: No bootstrap required, opened a new log
I20260808 05:54:50.936949 5391 ts_tablet_manager.cc:1397] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260808 05:54:50.937351 5391 raft_consensus.cc:348] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.937448 5391 raft_consensus.cc:374] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:50.937470 5391 raft_consensus.cc:729] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ac24136da54624a7c978e9c839f7d0, State: Initialized, Role: FOLLOWER
I20260808 05:54:50.937630 5391 consensus_queue.cc:260] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:50.937919 5391 ts_tablet_manager.cc:1428] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 05:54:51.058270 5373 raft_consensus.cc:482] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:54:51.058421 5373 raft_consensus.cc:504] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:51.058959 5373 leader_election.cc:288] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877), 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881)
I20260808 05:54:51.059458 5202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d06d65ac8bc343749ab2ac1dcfb2cb1c" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8642a667ec424f73b14437a2fb1c5e6f" is_pre_election: true
I20260808 05:54:51.059497 5053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d06d65ac8bc343749ab2ac1dcfb2cb1c" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" is_pre_election: true
I20260808 05:54:51.059733 5053 raft_consensus.cc:2454] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 0.
I20260808 05:54:51.059736 5202 raft_consensus.cc:2454] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 0.
I20260808 05:54:51.060052 4824 leader_election.cc:302] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8642a667ec424f73b14437a2fb1c5e6f, f4ac24136da54624a7c978e9c839f7d0; no voters:
I20260808 05:54:51.060335 5373 raft_consensus.cc:2781] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:54:51.060411 5373 raft_consensus.cc:482] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:54:51.060465 5373 raft_consensus.cc:3037] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:51.061621 5373 raft_consensus.cc:504] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:51.062007 5373 leader_election.cc:288] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 election: Requested vote from peers f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877), 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881)
I20260808 05:54:51.062383 5053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d06d65ac8bc343749ab2ac1dcfb2cb1c" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4"
I20260808 05:54:51.062568 5053 raft_consensus.cc:3037] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:51.063862 5202 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d06d65ac8bc343749ab2ac1dcfb2cb1c" candidate_uuid: "f4ac24136da54624a7c978e9c839f7d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8642a667ec424f73b14437a2fb1c5e6f"
I20260808 05:54:51.064011 5202 raft_consensus.cc:3037] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:51.064137 5053 raft_consensus.cc:2454] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 1.
I20260808 05:54:51.064502 4827 leader_election.cc:302] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f11c856673ba4a6fbdf3bb17389fe4c4, f4ac24136da54624a7c978e9c839f7d0; no voters:
I20260808 05:54:51.064713 5373 raft_consensus.cc:2781] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:51.064851 5373 raft_consensus.cc:686] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [term 1 LEADER]: Becoming Leader. State: Replica: f4ac24136da54624a7c978e9c839f7d0, State: Running, Role: LEADER
I20260808 05:54:51.065033 5373 consensus_queue.cc:237] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } }
I20260808 05:54:51.065716 5202 raft_consensus.cc:2454] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ac24136da54624a7c978e9c839f7d0 in term 1.
I20260808 05:54:51.067082 4726 catalog_manager.cc:5495] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "f4ac24136da54624a7c978e9c839f7d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4ac24136da54624a7c978e9c839f7d0" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 } health_report { overall_health: UNKNOWN } } }
I20260808 05:54:51.100654 5400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:51.096705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43566 (local address 127.2.191.65:33429)
0808 05:54:51.096874 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:51.096879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:51.096896 (+ 17us) server_negotiation.cc:407] Connection header received
0808 05:54:51.097030 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:51.097034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:51.097090 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:51.097180 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:54:51.097432 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:51.098528 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:51.099408 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:51.099767 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:51.099867 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:51.100117 (+ 250us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:54:51.100234 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:54:51.100325 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:51.100411 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 05:54:51.100473 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260808 05:54:51.108351 5202 raft_consensus.cc:1261] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Refusing update from remote peer f4ac24136da54624a7c978e9c839f7d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:51.108695 5053 raft_consensus.cc:1261] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Refusing update from remote peer f4ac24136da54624a7c978e9c839f7d0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:54:51.108906 5373 consensus_queue.cc:1035] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8642a667ec424f73b14437a2fb1c5e6f" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41881 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:54:51.109441 5373 consensus_queue.cc:1035] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f4ac24136da54624a7c978e9c839f7d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f11c856673ba4a6fbdf3bb17389fe4c4" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 05:54:51.122888 5352 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 05:54:52.674963 4724 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:52.675154 4724 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38148:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:54:52.677546 4724 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7f71bb3392024099b44a28016d1fddbb: Sending DeleteTablet for 3 replicas of tablet d06d65ac8bc343749ab2ac1dcfb2cb1c
I20260808 05:54:52.678153 4878 tablet_service.cc:1514] Processing DeleteTablet for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:43528
I20260808 05:54:52.678200 5031 tablet_service.cc:1514] Processing DeleteTablet for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:59652
I20260808 05:54:52.678292 5182 tablet_service.cc:1514] Processing DeleteTablet for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:54:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:47754
I20260808 05:54:52.678679 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 4806
I20260808 05:54:52.678735 5448 tablet_replica.cc:330] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: stopping tablet replica
I20260808 05:54:52.680673 5448 raft_consensus.cc:2229] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:52.680853 5448 raft_consensus.cc:2258] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:52.681839 5448 ts_tablet_manager.cc:1905] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:52.684139 5448 ts_tablet_manager.cc:1918] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:54:52.684216 5448 log.cc:1196] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/d06d65ac8bc343749ab2ac1dcfb2cb1c
I20260808 05:54:52.684541 5448 ts_tablet_manager.cc:1939] T d06d65ac8bc343749ab2ac1dcfb2cb1c P 8642a667ec424f73b14437a2fb1c5e6f: Deleting consensus metadata
I20260808 05:54:52.684921 5446 tablet_replica.cc:330] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: stopping tablet replica
I20260808 05:54:52.685079 5446 raft_consensus.cc:2229] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:54:52.685240 5446 raft_consensus.cc:2258] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:54:52.685662 4706 catalog_manager.cc:4841] TS 8642a667ec424f73b14437a2fb1c5e6f (127.2.191.67:41881): tablet d06d65ac8bc343749ab2ac1dcfb2cb1c (table test-table [id=4b1bfcb315ff4d4cbc445eb5aef6569d]) successfully deleted
I20260808 05:54:52.686026 5446 ts_tablet_manager.cc:1905] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:54:52.688098 5446 ts_tablet_manager.cc:1918] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:54:52.688198 5446 log.cc:1196] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/d06d65ac8bc343749ab2ac1dcfb2cb1c
I20260808 05:54:52.688443 5446 ts_tablet_manager.cc:1939] T d06d65ac8bc343749ab2ac1dcfb2cb1c P f11c856673ba4a6fbdf3bb17389fe4c4: Deleting consensus metadata
I20260808 05:54:52.689237 4710 catalog_manager.cc:4841] TS f11c856673ba4a6fbdf3bb17389fe4c4 (127.2.191.66:33877): tablet d06d65ac8bc343749ab2ac1dcfb2cb1c (table test-table [id=4b1bfcb315ff4d4cbc445eb5aef6569d]) successfully deleted
W20260808 05:54:52.690681 4710 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:33429 (error 108)
I20260808 05:54:52.690986 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 4960
I20260808 05:54:52.693867 5450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:52.693284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33429 (local address 127.0.0.1:43580)
0808 05:54:52.693621 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:52.693723 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:33429: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":99,"threads_started":1}
W20260808 05:54:52.694041 4710 catalog_manager.cc:4584] TS f4ac24136da54624a7c978e9c839f7d0 (127.2.191.65:33429): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d06d65ac8bc343749ab2ac1dcfb2cb1c: Network error: Client connection negotiation failed: client connection to 127.2.191.65:33429: connect: Connection refused (error 111)
I20260808 05:54:52.700618 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 5112
I20260808 05:54:52.709600 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 4688
2026-08-08T05:54:52Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6719 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:54:52 dist-test-slave-qg60 krb5kdc[5453](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:54:52 dist-test-slave-qg60 krb5kdc[5453](info): set up 2 sockets
Aug 08 05:54:52 dist-test-slave-qg60 krb5kdc[5453](info): commencing operation
krb5kdc: starting...
W20260808 05:54:53.841595 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:54:53 dist-test-slave-qg60 krb5kdc[5453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168493, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:54:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:54:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:54:53.984951 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:41581
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:35199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:41581
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:54.104262 5468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:54.104607 5468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:54.104710 5468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:54.109422 5468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:54:54.109534 5468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:54.109579 5468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:54.109655 5468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:54:54.109699 5468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:54:54.115751 5468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:35199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:41581
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:41581
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:54.117064 5468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:54.118228 5468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:54.127964 5473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:54.127928 5474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:54.127926 5476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:54.127981 5468 server_base.cc:1034] running on GCE node
I20260808 05:54:54.128969 5468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:54.130194 5468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:54.131413 5468 hybrid_clock.cc:648] HybridClock initialized: now 1786168494131389 us; error 35 us; skew 500 ppm
Aug 08 05:54:54 dist-test-slave-qg60 krb5kdc[5453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168494, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:54.134598 5468 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:54:54.135603 5468 webserver.cc:460] Webserver started at http://127.2.191.126:34627/ using document root <none> and password file <none>
I20260808 05:54:54.136272 5468 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:54.136348 5468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:54.136621 5468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:54.138833 5468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "cbcb1fc74b8f4213986c33966b7d2cb5"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "acd80cc38827225724d5a4c21baae795"
server_key_iv: "9683a765ad12b47e450a5e47c3feeb7b"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.139449 5468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "cbcb1fc74b8f4213986c33966b7d2cb5"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "acd80cc38827225724d5a4c21baae795"
server_key_iv: "9683a765ad12b47e450a5e47c3feeb7b"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.143481 5468 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:54:54.146198 5485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.147579 5468 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:54:54.147750 5468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "cbcb1fc74b8f4213986c33966b7d2cb5"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "acd80cc38827225724d5a4c21baae795"
server_key_iv: "9683a765ad12b47e450a5e47c3feeb7b"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.147882 5468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:54.164621 5468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:54.168183 5468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:54.168465 5468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:54.177364 5468 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:41581
I20260808 05:54:54.177412 5545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:41581 every 8 connection(s)
I20260808 05:54:54.178411 5468 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:54:54.181630 5546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:54.182817 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 5468
I20260808 05:54:54.182920 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:54:54.183226 2813 external_mini_cluster.cc:1428] Setting key 86f226e9a20d087d0eff8ee83180cdbf
I20260808 05:54:54.189518 5546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5: Bootstrap starting.
I20260808 05:54:54.192564 5546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:54.193470 5546 log.cc:824] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5: Log is configured to *not* fsync() on all Append() calls
Aug 08 05:54:54 dist-test-slave-qg60 krb5kdc[5453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168493, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:54.195945 5546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5: No bootstrap required, opened a new log
I20260808 05:54:54.199801 5546 raft_consensus.cc:348] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbcb1fc74b8f4213986c33966b7d2cb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41581 } }
I20260808 05:54:54.200023 5546 raft_consensus.cc:374] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:54.200031 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:54.184883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36344 (local address 127.2.191.126:41581)
0808 05:54:54.185399 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:54.185423 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:54.185477 (+ 54us) server_negotiation.cc:407] Connection header received
0808 05:54:54.186434 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:54.186461 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:54.186944 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:54.187366 (+ 422us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:54.188154 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.189841 (+ 1687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.190784 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.191556 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.191734 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:54.194764 (+ 3030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:54.194771 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:54.194795 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:54.194825 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:54.196889 (+ 2064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:54.197388 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:54.197395 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:54.197401 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:54.197553 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:54.197876 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:54.197881 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:54.197883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:54.198324 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:54.198541 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:54.198871 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 05:54:54.199188 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":140,"threads_started":1}
I20260808 05:54:54.200106 5546 raft_consensus.cc:729] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbcb1fc74b8f4213986c33966b7d2cb5, State: Initialized, Role: FOLLOWER
I20260808 05:54:54.200578 5546 consensus_queue.cc:260] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbcb1fc74b8f4213986c33966b7d2cb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41581 } }
I20260808 05:54:54.200716 5546 raft_consensus.cc:388] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:54:54.200831 5546 raft_consensus.cc:482] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:54:54.200945 5546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:54.202158 5546 raft_consensus.cc:504] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbcb1fc74b8f4213986c33966b7d2cb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41581 } }
I20260808 05:54:54.202523 5546 leader_election.cc:302] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbcb1fc74b8f4213986c33966b7d2cb5; no voters:
I20260808 05:54:54.202940 5546 leader_election.cc:288] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:54:54.203087 5551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:54.203369 5551 raft_consensus.cc:686] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [term 1 LEADER]: Becoming Leader. State: Replica: cbcb1fc74b8f4213986c33966b7d2cb5, State: Running, Role: LEADER
I20260808 05:54:54.203706 5551 consensus_queue.cc:237] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbcb1fc74b8f4213986c33966b7d2cb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41581 } }
I20260808 05:54:54.204214 5546 sys_catalog.cc:564] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:54:54.205542 5553 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cbcb1fc74b8f4213986c33966b7d2cb5. Latest consensus state: current_term: 1 leader_uuid: "cbcb1fc74b8f4213986c33966b7d2cb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbcb1fc74b8f4213986c33966b7d2cb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41581 } } }
I20260808 05:54:54.205709 5553 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:54.206010 5552 sys_catalog.cc:455] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cbcb1fc74b8f4213986c33966b7d2cb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbcb1fc74b8f4213986c33966b7d2cb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41581 } } }
I20260808 05:54:54.206135 5552 sys_catalog.cc:458] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:54.206163 5560 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:54:54.209648 5560 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:54:54.215785 5560 catalog_manager.cc:1347] Generated new cluster ID: ffec6105a26a467484e4237d220bae88
I20260808 05:54:54.215873 5560 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:54:54.228252 5560 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:54:54.229463 5560 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:54:54.239019 5560 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cbcb1fc74b8f4213986c33966b7d2cb5: Generated new TSK 0
I20260808 05:54:54.239773 5560 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:54:54.274438 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41581
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:35199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:54.392278 5572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:54.392614 5572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:54.392709 5572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:54.396806 5572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:54.396906 5572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:54.397006 5572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:54:54.402696 5572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:35199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:54.403842 5572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:54.405082 5572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:54.415582 5580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:54.415678 5577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:54.415588 5578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:54.415665 5572 server_base.cc:1034] running on GCE node
I20260808 05:54:54.416309 5572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:54.417186 5572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:54.418411 5572 hybrid_clock.cc:648] HybridClock initialized: now 1786168494418386 us; error 36 us; skew 500 ppm
Aug 08 05:54:54 dist-test-slave-qg60 krb5kdc[5453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168494, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:54.421839 5572 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:54:54.422699 5572 webserver.cc:460] Webserver started at http://127.2.191.65:45147/ using document root <none> and password file <none>
I20260808 05:54:54.423239 5572 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:54.423298 5572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:54.423462 5572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:54.425606 5572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "06d75098417f46309e3c023451c33eb0"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "c0412be65d4d74ec86f46244e58eb913"
server_key_iv: "7e6a03c956e960d3545df4471dc3d12f"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.426168 5572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "06d75098417f46309e3c023451c33eb0"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "c0412be65d4d74ec86f46244e58eb913"
server_key_iv: "7e6a03c956e960d3545df4471dc3d12f"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.429981 5572 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 05:54:54.432471 5587 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.433771 5572 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 05:54:54.433872 5572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "06d75098417f46309e3c023451c33eb0"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "c0412be65d4d74ec86f46244e58eb913"
server_key_iv: "7e6a03c956e960d3545df4471dc3d12f"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.433964 5572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:54.449477 5572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:54.453078 5572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:54.453253 5572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:54.453830 5572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:54.454676 5572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:54.454730 5572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.454770 5572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:54.454787 5572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.464188 5572 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:34559
I20260808 05:54:54.464263 5715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:34559 every 8 connection(s)
I20260808 05:54:54.465220 5572 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:54:54.472393 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 5572
I20260808 05:54:54.472515 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:54:54.472842 2813 external_mini_cluster.cc:1428] Setting key ea6b01cc77675ec6acde486ecfa49339
Aug 08 05:54:54 dist-test-slave-qg60 krb5kdc[5453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168494, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:54.480232 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:54.467138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:36169 (local address 127.2.191.126:41581)
0808 05:54:54.467299 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:54.467303 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:54.468111 (+ 808us) server_negotiation.cc:407] Connection header received
0808 05:54:54.469602 (+ 1491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:54.469605 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:54.469665 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:54.469780 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:54.470957 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.471508 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.473065 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.473327 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.473464 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:54.476237 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:54.476241 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:54.476244 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:54.476277 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:54.477799 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:54.478492 (+ 693us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:54.478495 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:54.478496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:54.478587 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:54.479004 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:54.479006 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:54.479007 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:54.479195 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:54.479276 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:54.479986 (+ 710us) server_negotiation.cc:299] Negotiation successful
0808 05:54:54.480105 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 05:54:54.481632 5718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:54.467507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41581 (local address 127.2.191.65:36169)
0808 05:54:54.467950 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:54.467997 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:54.469317 (+ 1320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:54.469956 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:54.469963 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:54.470319 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:54.470806 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:54.470819 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.471642 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.471645 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:54.472870 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:54.472885 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.473509 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.473513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:54.473705 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:54.474341 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:54.474358 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:54.476051 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:54.477930 (+ 1879us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:54.477939 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:54.477959 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:54.478349 (+ 390us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:54.478694 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:54.478700 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:54.478704 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:54.478902 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:54.479309 (+ 407us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:54.479319 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:54.479694 (+ 375us) client_negotiation.cc:769] Sending connection context
0808 05:54:54.479942 (+ 248us) client_negotiation.cc:240] Negotiation successful
0808 05:54:54.480349 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":103,"threads_started":1}
I20260808 05:54:54.483126 5716 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41581
I20260808 05:54:54.483402 5716 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:54.483948 5716 heartbeater.cc:511] Master 127.2.191.126:41581 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:54:54.485564 5497 ts_manager.cc:194] Registered new tserver with Master: 06d75098417f46309e3c023451c33eb0 (127.2.191.65:34559)
I20260808 05:54:54.486763 5497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:36169
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:54:54.504464 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41581
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:35199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:54.621508 5721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:54.621819 5721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:54.621896 5721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:54.625968 5721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:54.626076 5721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:54.626169 5721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:54:54.632118 5721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:35199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:54.633262 5721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:54.634320 5721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:54.644260 5731 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:54.644268 5727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:54.644268 5728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:54.644564 5721 server_base.cc:1034] running on GCE node
I20260808 05:54:54.645077 5721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:54.645788 5721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:54.647043 5721 hybrid_clock.cc:648] HybridClock initialized: now 1786168494647041 us; error 85 us; skew 500 ppm
Aug 08 05:54:54 dist-test-slave-qg60 krb5kdc[5453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168494, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:54.650259 5721 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:54:54.651481 5721 webserver.cc:460] Webserver started at http://127.2.191.66:35131/ using document root <none> and password file <none>
I20260808 05:54:54.652232 5721 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:54.652344 5721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:54.652593 5721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:54.655681 5721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "91f8d53c19314dd0a4767880a1647290"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "fdfba157ca0178e6e450cf36cf7c48f5"
server_key_iv: "d687315df178dff4d786a7a4c1c22eea"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.656401 5721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "91f8d53c19314dd0a4767880a1647290"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "fdfba157ca0178e6e450cf36cf7c48f5"
server_key_iv: "d687315df178dff4d786a7a4c1c22eea"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.660898 5721 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.007s sys 0.000s
I20260808 05:54:54.663853 5740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.665266 5721 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:54:54.665418 5721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "91f8d53c19314dd0a4767880a1647290"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "fdfba157ca0178e6e450cf36cf7c48f5"
server_key_iv: "d687315df178dff4d786a7a4c1c22eea"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.665549 5721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:54.679888 5721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:54.683624 5721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:54.683863 5721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:54.684531 5721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:54.685482 5721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:54.685575 5721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.685655 5721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:54.685714 5721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.696249 5721 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:37617
I20260808 05:54:54.696303 5866 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:37617 every 8 connection(s)
I20260808 05:54:54.697345 5721 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:54:54.702410 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 5721
I20260808 05:54:54.702566 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:54:54.702865 2813 external_mini_cluster.cc:1428] Setting key d7d18b7de02b52ccce7ae51ce55662df
Aug 08 05:54:54 dist-test-slave-qg60 krb5kdc[5453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168494, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:54.714463 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:54.699601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:42521 (local address 127.2.191.126:41581)
0808 05:54:54.699771 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:54.699776 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:54.700763 (+ 987us) server_negotiation.cc:407] Connection header received
0808 05:54:54.702304 (+ 1541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:54.702308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:54.702374 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:54.702491 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:54.703991 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.704875 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.706538 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.706927 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.707060 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:54.710194 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:54.710198 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:54.710201 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:54.710230 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:54.711820 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:54.712577 (+ 757us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:54.712580 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:54.712581 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:54.712661 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:54.713161 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:54.713164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:54.713166 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:54.713377 (+ 211us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:54.713481 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:54.714195 (+ 714us) server_negotiation.cc:299] Negotiation successful
0808 05:54:54.714323 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:54:54.715727 5869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:54.700095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41581 (local address 127.2.191.66:42521)
0808 05:54:54.700575 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:54.700631 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:54.702045 (+ 1414us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:54.702724 (+ 679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:54.702734 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:54.703192 (+ 458us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:54.703825 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:54.703840 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.705060 (+ 1220us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.705065 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:54.706409 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:54.706419 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.707105 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.707109 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:54.707275 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:54.708052 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:54.708069 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:54.709989 (+ 1920us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:54.711956 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:54.711967 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:54.711987 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:54.712445 (+ 458us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:54.712786 (+ 341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:54.712789 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:54.712792 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:54.713008 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:54.713506 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:54.713515 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:54.713879 (+ 364us) client_negotiation.cc:769] Sending connection context
0808 05:54:54.714131 (+ 252us) client_negotiation.cc:240] Negotiation successful
0808 05:54:54.714554 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"thread_start_us":127,"threads_started":1}
I20260808 05:54:54.717029 5867 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41581
I20260808 05:54:54.717295 5867 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:54.717841 5867 heartbeater.cc:511] Master 127.2.191.126:41581 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:54:54.719084 5497 ts_manager.cc:194] Registered new tserver with Master: 91f8d53c19314dd0a4767880a1647290 (127.2.191.66:37617)
I20260808 05:54:54.719766 5497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:42521
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:54:54.736418 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41581
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:35199
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:54.855607 5872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:54.855892 5872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:54.855938 5872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:54.860232 5872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:54.860309 5872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:54.860405 5872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:54:54.866192 5872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:35199
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41581
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:54.867368 5872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:54.868438 5872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:54.878528 5879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:54.878548 5880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:54.878551 5882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:54.878636 5872 server_base.cc:1034] running on GCE node
I20260808 05:54:54.879226 5872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:54.879913 5872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:54.881083 5872 hybrid_clock.cc:648] HybridClock initialized: now 1786168494881062 us; error 32 us; skew 500 ppm
Aug 08 05:54:54 dist-test-slave-qg60 krb5kdc[5453](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168494, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:54.883841 5872 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:54:54.884783 5872 webserver.cc:460] Webserver started at http://127.2.191.67:46497/ using document root <none> and password file <none>
I20260808 05:54:54.885376 5872 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:54.885442 5872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:54.885615 5872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:54.887681 5872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "23104dea446d4bc1adef8031e35fe601"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "3a40e2b50268497de6b7bfaf365bcdb5"
server_key_iv: "c495d7518646fe0a7cd53e156cf09ae6"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.888213 5872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "23104dea446d4bc1adef8031e35fe601"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "3a40e2b50268497de6b7bfaf365bcdb5"
server_key_iv: "c495d7518646fe0a7cd53e156cf09ae6"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.892081 5872 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:54:54.894767 5889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.896202 5872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:54.896313 5872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "23104dea446d4bc1adef8031e35fe601"
format_stamp: "Formatted at 2026-08-08 05:54:54 on dist-test-slave-qg60"
server_key: "3a40e2b50268497de6b7bfaf365bcdb5"
server_key_iv: "c495d7518646fe0a7cd53e156cf09ae6"
server_key_version: "encryptionkey@0"
I20260808 05:54:54.896417 5872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:54.916507 5872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:54.919942 5872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:54.920127 5872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:54.920826 5872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:54.921657 5872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:54.921706 5872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.921746 5872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:54.921761 5872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:54.930784 5872 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:37975
I20260808 05:54:54.930809 6016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:37975 every 8 connection(s)
I20260808 05:54:54.931718 5872 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:54:54.934304 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 5872
I20260808 05:54:54.934445 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:54:54.934782 2813 external_mini_cluster.cc:1428] Setting key 106ac89f28426357cc9d95851c71e79f
Aug 08 05:54:54 dist-test-slave-qg60 krb5kdc[5453](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168494, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:54.946332 5549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:54.933722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:48993 (local address 127.2.191.126:41581)
0808 05:54:54.933903 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:54.933907 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:54.934793 (+ 886us) server_negotiation.cc:407] Connection header received
0808 05:54:54.936423 (+ 1630us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:54.936426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:54.936481 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:54.936569 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:54.938046 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.938598 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.939758 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.939995 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.940110 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:54.942664 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:54.942668 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:54.942671 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:54.942704 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:54.944168 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:54.944704 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:54.944708 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:54.944710 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:54.944840 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:54.945237 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:54.945241 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:54.945243 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:54.945432 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:54.945543 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:54.946039 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 05:54:54.946164 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 05:54:54.947165 6020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:54.934132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41581 (local address 127.2.191.67:48993)
0808 05:54:54.934614 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:54.934670 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:54.936229 (+ 1559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:54.936828 (+ 599us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:54.936836 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:54.937347 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:54.937846 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:54.937886 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.938728 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.938732 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:54.939627 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:54.939636 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:54.940160 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:54.940164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:54.940334 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:54.941003 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:54.941019 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:54.942492 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:54.944306 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:54.944312 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:54.944328 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:54.944594 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:54.944970 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:54.944976 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:54.944978 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:54.945135 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:54.945540 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:54.945547 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:54.945796 (+ 249us) client_negotiation.cc:769] Sending connection context
0808 05:54:54.945994 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 05:54:54.946336 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":142,"threads_started":1}
I20260808 05:54:54.948601 6017 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41581
I20260808 05:54:54.948901 6017 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:54.949539 6017 heartbeater.cc:511] Master 127.2.191.126:41581 requested a full tablet report, sending...
I20260808 05:54:54.950579 5497 ts_manager.cc:194] Registered new tserver with Master: 23104dea446d4bc1adef8031e35fe601 (127.2.191.67:37975)
I20260808 05:54:54.951116 5497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:48993
I20260808 05:54:54.961547 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:54:54.978404 5549 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:54:54.976768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36346 (local address 127.2.191.126:41581)
0808 05:54:54.976948 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:54.976953 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:54.977119 (+ 166us) server_negotiation.cc:407] Connection header received
0808 05:54:54.977220 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:54.977222 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:54.977270 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:54.977347 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:54.978248 (+ 901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36346: BlockingRecv error: recv got EOF from 127.0.0.1:36346 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 05:54:54.979586 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 5572
I20260808 05:54:54.988049 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 5721
I20260808 05:54:54.995505 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 5872
I20260808 05:54:55.004987 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 5468
2026-08-08T05:54:55Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2293 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:54:55 dist-test-slave-qg60 krb5kdc[6033](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:54:55 dist-test-slave-qg60 krb5kdc[6033](info): set up 2 sockets
Aug 08 05:54:55 dist-test-slave-qg60 krb5kdc[6033](info): commencing operation
krb5kdc: starting...
W20260808 05:54:56.121554 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.091s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:54:56 dist-test-slave-qg60 krb5kdc[6033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:54:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:54:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:54:56.257977 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42241
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:36101
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:42241
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:56.374019 6047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:56.374361 6047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:56.374446 6047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:56.378960 6047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:54:56.379086 6047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:56.379128 6047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:56.379175 6047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:54:56.379209 6047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:54:56.384717 6047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36101
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:42241
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42241
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:56.385905 6047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:56.386987 6047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:56.396188 6055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:56.396188 6052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:56.396375 6047 server_base.cc:1034] running on GCE node
W20260808 05:54:56.396266 6053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:56.397171 6047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:56.398316 6047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:56.399507 6047 hybrid_clock.cc:648] HybridClock initialized: now 1786168496399467 us; error 42 us; skew 500 ppm
Aug 08 05:54:56 dist-test-slave-qg60 krb5kdc[6033](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168496, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:56.405936 6047 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:54:56.406826 6047 webserver.cc:460] Webserver started at http://127.2.191.126:46395/ using document root <none> and password file <none>
I20260808 05:54:56.407370 6047 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:56.407430 6047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:56.407634 6047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:56.410185 6047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "58de015469e54eb4aec33a55b1cd80b6"
format_stamp: "Formatted at 2026-08-08 05:54:56 on dist-test-slave-qg60"
server_key: "fd9f401d9b030df9e70516dcc97c8381"
server_key_iv: "62bfef6e3246afed7b98b4a14f5859e4"
server_key_version: "encryptionkey@0"
I20260808 05:54:56.410722 6047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "58de015469e54eb4aec33a55b1cd80b6"
format_stamp: "Formatted at 2026-08-08 05:54:56 on dist-test-slave-qg60"
server_key: "fd9f401d9b030df9e70516dcc97c8381"
server_key_iv: "62bfef6e3246afed7b98b4a14f5859e4"
server_key_version: "encryptionkey@0"
I20260808 05:54:56.414525 6047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 05:54:56.416990 6062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:56.418292 6047 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:54:56.418411 6047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "58de015469e54eb4aec33a55b1cd80b6"
format_stamp: "Formatted at 2026-08-08 05:54:56 on dist-test-slave-qg60"
server_key: "fd9f401d9b030df9e70516dcc97c8381"
server_key_iv: "62bfef6e3246afed7b98b4a14f5859e4"
server_key_version: "encryptionkey@0"
I20260808 05:54:56.418500 6047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:56.446559 6047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:56.450038 6047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:56.450205 6047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:56.457448 6047 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:42241
I20260808 05:54:56.457768 6116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:42241 every 8 connection(s)
I20260808 05:54:56.458487 6047 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:54:56.461545 6117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:56.465534 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 6047
I20260808 05:54:56.465684 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:54:56.465961 2813 external_mini_cluster.cc:1428] Setting key d7b56a37b12927d3cd2f3cf6e356a9ab
I20260808 05:54:56.467882 6117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6: Bootstrap starting.
I20260808 05:54:56.470553 6117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:56.471338 6117 log.cc:824] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:56.473625 6117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6: No bootstrap required, opened a new log
Aug 08 05:54:56 dist-test-slave-qg60 krb5kdc[6033](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:56.477809 6117 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58de015469e54eb4aec33a55b1cd80b6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42241 } }
I20260808 05:54:56.478078 6117 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:56.478143 6117 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58de015469e54eb4aec33a55b1cd80b6, State: Initialized, Role: FOLLOWER
I20260808 05:54:56.478670 6117 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58de015469e54eb4aec33a55b1cd80b6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42241 } }
I20260808 05:54:56.478883 6117 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:54:56.478976 6117 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:54:56.479087 6117 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:56.480013 6117 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58de015469e54eb4aec33a55b1cd80b6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42241 } }
I20260808 05:54:56.480404 6117 leader_election.cc:302] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58de015469e54eb4aec33a55b1cd80b6; no voters:
I20260808 05:54:56.480777 6117 leader_election.cc:288] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:54:56.480858 6122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:56.481091 6122 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [term 1 LEADER]: Becoming Leader. State: Replica: 58de015469e54eb4aec33a55b1cd80b6, State: Running, Role: LEADER
I20260808 05:54:56.481377 6120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:56.467544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51120 (local address 127.2.191.126:42241)
0808 05:54:56.467979 (+ 435us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:56.468003 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:56.468058 (+ 55us) server_negotiation.cc:407] Connection header received
0808 05:54:56.468782 (+ 724us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:56.468812 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:56.469166 (+ 354us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:56.469443 (+ 277us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:56.470427 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:56.471536 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:56.472661 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:56.473239 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:56.473363 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:56.476154 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:56.476160 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:56.476172 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:56.476199 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:56.478008 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:56.478552 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:56.478558 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:56.478564 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:56.478697 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:56.479017 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:56.479022 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:56.479026 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:56.479478 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:56.479694 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:56.479994 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 05:54:56.480311 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":281,"thread_start_us":148,"threads_started":1}
I20260808 05:54:56.481585 6122 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58de015469e54eb4aec33a55b1cd80b6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42241 } }
I20260808 05:54:56.482144 6117 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:54:56.483806 6123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58de015469e54eb4aec33a55b1cd80b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58de015469e54eb4aec33a55b1cd80b6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42241 } } }
I20260808 05:54:56.483930 6123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:56.484329 6124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58de015469e54eb4aec33a55b1cd80b6. Latest consensus state: current_term: 1 leader_uuid: "58de015469e54eb4aec33a55b1cd80b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58de015469e54eb4aec33a55b1cd80b6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42241 } } }
I20260808 05:54:56.484479 6124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:56.484689 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:54:56.485352 6136 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:54:56.488440 6136 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:54:56.496834 6136 catalog_manager.cc:1347] Generated new cluster ID: 6f54d44f2a8d4ea69aca6deaef796c71
I20260808 05:54:56.496901 6136 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:54:56.505971 6120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:56.500204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51128 (local address 127.2.191.126:42241)
0808 05:54:56.500326 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:56.500332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:56.500549 (+ 217us) server_negotiation.cc:407] Connection header received
0808 05:54:56.500685 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:56.500688 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:56.500769 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:56.500851 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:56.501483 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:56.502298 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:56.503493 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:56.503864 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:56.503975 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:56.504944 (+ 969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:56.504948 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:56.504951 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:54:56.505497 (+ 546us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:56.505530 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:54:56.505549 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:56.505631 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:56.505758 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 05:54:56.505824 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:54:56.510808 6136 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:54:56.511677 6136 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:54:56.522930 6136 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58de015469e54eb4aec33a55b1cd80b6: Generated new TSK 0
I20260808 05:54:56.523772 6136 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:54:56.537423 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 6047
2026-08-08T05:54:56Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1529 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:54:56 dist-test-slave-qg60 krb5kdc[6153](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:54:56 dist-test-slave-qg60 krb5kdc[6153](info): set up 2 sockets
Aug 08 05:54:56 dist-test-slave-qg60 krb5kdc[6153](info): commencing operation
krb5kdc: starting...
W20260808 05:54:57.669378 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:54:57 dist-test-slave-qg60 krb5kdc[6153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:54:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:54:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:54:57.809213 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:39607
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:39607
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:57.925997 6167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:57.926357 6167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:57.926456 6167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:57.931293 6167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:54:57.931389 6167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:57.931425 6167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:57.931468 6167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:54:57.931504 6167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:54:57.937408 6167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:39607
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:39607
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:57.938658 6167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:57.939734 6167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:57.948892 6173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:57.949008 6167 server_base.cc:1034] running on GCE node
W20260808 05:54:57.948956 6175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:57.948936 6172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:57.949842 6167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:57.950999 6167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:57.952206 6167 hybrid_clock.cc:648] HybridClock initialized: now 1786168497952178 us; error 43 us; skew 500 ppm
Aug 08 05:54:57 dist-test-slave-qg60 krb5kdc[6153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168497, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:57.955231 6167 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:54:57.956215 6167 webserver.cc:460] Webserver started at http://127.2.191.126:38821/ using document root <none> and password file <none>
I20260808 05:54:57.956876 6167 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:57.956975 6167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:57.957222 6167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:57.959363 6167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "1f60c1abb96b4667b5e0ca068ea1d887"
format_stamp: "Formatted at 2026-08-08 05:54:57 on dist-test-slave-qg60"
server_key: "70f2c43448e64f33a1231c2bfd983fde"
server_key_iv: "bc16aee7d092327e22ce8f0051c275d5"
server_key_version: "encryptionkey@0"
I20260808 05:54:57.959996 6167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "1f60c1abb96b4667b5e0ca068ea1d887"
format_stamp: "Formatted at 2026-08-08 05:54:57 on dist-test-slave-qg60"
server_key: "70f2c43448e64f33a1231c2bfd983fde"
server_key_iv: "bc16aee7d092327e22ce8f0051c275d5"
server_key_version: "encryptionkey@0"
I20260808 05:54:57.963816 6167 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:54:57.966406 6183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:57.967711 6167 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:54:57.967868 6167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "1f60c1abb96b4667b5e0ca068ea1d887"
format_stamp: "Formatted at 2026-08-08 05:54:57 on dist-test-slave-qg60"
server_key: "70f2c43448e64f33a1231c2bfd983fde"
server_key_iv: "bc16aee7d092327e22ce8f0051c275d5"
server_key_version: "encryptionkey@0"
I20260808 05:54:57.967988 6167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:57.985539 6167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:57.989037 6167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:57.989296 6167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:57.997015 6167 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:39607
I20260808 05:54:57.997351 6237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:39607 every 8 connection(s)
I20260808 05:54:57.998111 6167 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:54:58.001178 6238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:54:58.007193 6238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887: Bootstrap starting.
I20260808 05:54:58.007279 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 6167
I20260808 05:54:58.007411 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:54:58.007715 2813 external_mini_cluster.cc:1428] Setting key 5ad8ee1e62cc65198b093601d7b215f4
I20260808 05:54:58.010141 6238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887: Neither blocks nor log segments found. Creating new log.
I20260808 05:54:58.011051 6238 log.cc:824] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887: Log is configured to *not* fsync() on all Append() calls
I20260808 05:54:58.013228 6238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887: No bootstrap required, opened a new log
I20260808 05:54:58.016803 6238 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f60c1abb96b4667b5e0ca068ea1d887" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39607 } }
I20260808 05:54:58.017086 6238 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:54:58.017181 6238 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f60c1abb96b4667b5e0ca068ea1d887, State: Initialized, Role: FOLLOWER
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168497, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:58.017817 6238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f60c1abb96b4667b5e0ca068ea1d887" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39607 } }
I20260808 05:54:58.017999 6238 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:54:58.018098 6238 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:54:58.018208 6238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:54:58.019578 6238 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f60c1abb96b4667b5e0ca068ea1d887" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39607 } }
I20260808 05:54:58.019972 6238 leader_election.cc:302] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f60c1abb96b4667b5e0ca068ea1d887; no voters:
I20260808 05:54:58.020367 6238 leader_election.cc:288] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:54:58.020503 6244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:54:58.020789 6244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [term 1 LEADER]: Becoming Leader. State: Replica: 1f60c1abb96b4667b5e0ca068ea1d887, State: Running, Role: LEADER
I20260808 05:54:58.021131 6244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f60c1abb96b4667b5e0ca068ea1d887" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39607 } }
I20260808 05:54:58.021924 6238 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:54:58.022476 6244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f60c1abb96b4667b5e0ca068ea1d887. Latest consensus state: current_term: 1 leader_uuid: "1f60c1abb96b4667b5e0ca068ea1d887" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f60c1abb96b4667b5e0ca068ea1d887" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39607 } } }
I20260808 05:54:58.022624 6244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:58.023532 6246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f60c1abb96b4667b5e0ca068ea1d887" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f60c1abb96b4667b5e0ca068ea1d887" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39607 } } }
I20260808 05:54:58.023701 6246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887 [sys.catalog]: This master's current role is: LEADER
I20260808 05:54:58.024101 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:58.009333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40696 (local address 127.2.191.126:39607)
0808 05:54:58.009805 (+ 472us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:58.009825 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:58.009870 (+ 45us) server_negotiation.cc:407] Connection header received
0808 05:54:58.010776 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:58.010801 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:58.011241 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:58.011639 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:58.012485 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.013641 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.014542 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.015035 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.015235 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:58.018137 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:58.018146 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:58.018164 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:58.018202 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:58.020371 (+ 2169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.020971 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.020977 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.020983 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.021134 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.021489 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.021492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.021494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.022046 (+ 552us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:58.022254 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:58.022616 (+ 362us) server_negotiation.cc:299] Negotiation successful
0808 05:54:58.022984 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":125,"threads_started":1}
I20260808 05:54:58.024127 6250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:54:58.027529 6250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:54:58.032896 6250 catalog_manager.cc:1347] Generated new cluster ID: 91cbabdcb2e44349ac64d8c21783c3a0
I20260808 05:54:58.032980 6250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:54:58.071586 6250 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:54:58.072992 6250 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:54:58.082422 6250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f60c1abb96b4667b5e0ca068ea1d887: Generated new TSK 0
I20260808 05:54:58.083303 6250 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:54:58.127921 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39607
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:58.246096 6267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:58.246378 6267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:58.246460 6267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:58.250571 6267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:58.250645 6267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:58.250748 6267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:54:58.256170 6267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6267
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:58.257324 6267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:58.258374 6267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:54:58.268446 6267 server_base.cc:1034] running on GCE node
W20260808 05:54:58.268383 6275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:58.268415 6274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:58.268383 6278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:58.269164 6267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:58.269833 6267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:58.271003 6267 hybrid_clock.cc:648] HybridClock initialized: now 1786168498270975 us; error 42 us; skew 500 ppm
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168498, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:58.274140 6267 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:54:58.275045 6267 webserver.cc:460] Webserver started at http://127.2.191.65:36331/ using document root <none> and password file <none>
I20260808 05:54:58.275581 6267 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:58.275653 6267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:58.275825 6267 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:58.277997 6267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "1112e7891d3c4706b397010e6d7a2558"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "e72fa38b8e146e1dce1d5787a6d52946"
server_key_iv: "571bce8185154d94d92256352a08ad57"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.278523 6267 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "1112e7891d3c4706b397010e6d7a2558"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "e72fa38b8e146e1dce1d5787a6d52946"
server_key_iv: "571bce8185154d94d92256352a08ad57"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.282281 6267 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:54:58.285128 6285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.286430 6267 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:54:58.286559 6267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "1112e7891d3c4706b397010e6d7a2558"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "e72fa38b8e146e1dce1d5787a6d52946"
server_key_iv: "571bce8185154d94d92256352a08ad57"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.286688 6267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:58.306103 6267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:58.309638 6267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:58.309854 6267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:58.310491 6267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:58.311371 6267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:58.311445 6267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.311522 6267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:58.311566 6267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.320648 6267 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:34785
I20260808 05:54:58.320717 6409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:34785 every 8 connection(s)
I20260808 05:54:58.321628 6267 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:54:58.325451 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 6267
I20260808 05:54:58.325594 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:54:58.325882 2813 external_mini_cluster.cc:1428] Setting key cd0589a1a43e4437e4377dad8cff036c
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168498, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:54:58.337736 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:58.323683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:44285 (local address 127.2.191.126:39607)
0808 05:54:58.323825 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:58.323829 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:58.324784 (+ 955us) server_negotiation.cc:407] Connection header received
0808 05:54:58.326349 (+ 1565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:58.326352 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:58.326416 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:58.326536 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:58.327872 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.328453 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.330184 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.330430 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.330515 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:58.333794 (+ 3279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:58.333797 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:58.333799 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:58.333828 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:58.335358 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.335983 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.335985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.335986 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.336062 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.336487 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.336490 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.336491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.336679 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:58.336821 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:58.337473 (+ 652us) server_negotiation.cc:299] Negotiation successful
0808 05:54:58.337608 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:54:58.338608 6413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:58.324039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39607 (local address 127.2.191.65:44285)
0808 05:54:58.324578 (+ 539us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:58.324624 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:58.326124 (+ 1500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:58.326715 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:58.326722 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:58.327197 (+ 475us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:58.327709 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:58.327724 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.328601 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.328607 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:58.330018 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:58.330033 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.330601 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.330608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:58.330871 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:58.331546 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:58.331573 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:58.333582 (+ 2009us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:58.335486 (+ 1904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:58.335494 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:58.335513 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:58.335868 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:58.336153 (+ 285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:58.336156 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:58.336158 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:58.336383 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:58.336830 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:58.336839 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:58.337216 (+ 377us) client_negotiation.cc:769] Sending connection context
0808 05:54:58.337400 (+ 184us) client_negotiation.cc:240] Negotiation successful
0808 05:54:58.337692 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":181,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:54:58.340130 6411 heartbeater.cc:347] Connected to a master server at 127.2.191.126:39607
I20260808 05:54:58.340399 6411 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:58.340981 6411 heartbeater.cc:511] Master 127.2.191.126:39607 requested a full tablet report, sending...
I20260808 05:54:58.342628 6200 ts_manager.cc:194] Registered new tserver with Master: 1112e7891d3c4706b397010e6d7a2558 (127.2.191.65:34785)
I20260808 05:54:58.344266 6200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:44285
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:54:58.359776 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39607
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:58.475147 6416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:58.475490 6416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:58.475615 6416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:58.479693 6416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:58.479784 6416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:58.479887 6416 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:54:58.485321 6416 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:58.486407 6416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:58.487457 6416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:58.497403 6421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:58.497519 6422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:58.497403 6424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:58.497759 6416 server_base.cc:1034] running on GCE node
I20260808 05:54:58.498203 6416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:58.498836 6416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:58.500000 6416 hybrid_clock.cc:648] HybridClock initialized: now 1786168498499971 us; error 41 us; skew 500 ppm
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168498, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:58.502884 6416 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:54:58.503736 6416 webserver.cc:460] Webserver started at http://127.2.191.66:39913/ using document root <none> and password file <none>
I20260808 05:54:58.504309 6416 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:58.504407 6416 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:58.504647 6416 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:58.506861 6416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "07ba85aa284442a1bcfaf5a0549cbe44"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "8d8f9ed03964b6728f424693fd17547c"
server_key_iv: "0245d67adbd65586dc16fe5fc4ac030f"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.507467 6416 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "07ba85aa284442a1bcfaf5a0549cbe44"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "8d8f9ed03964b6728f424693fd17547c"
server_key_iv: "0245d67adbd65586dc16fe5fc4ac030f"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.511513 6416 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:54:58.514179 6432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.515527 6416 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:54:58.515689 6416 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "07ba85aa284442a1bcfaf5a0549cbe44"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "8d8f9ed03964b6728f424693fd17547c"
server_key_iv: "0245d67adbd65586dc16fe5fc4ac030f"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.515815 6416 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:58.571892 6416 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:58.575367 6416 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:58.575599 6416 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:58.576260 6416 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:58.577190 6416 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:58.577265 6416 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.577329 6416 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:58.577371 6416 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.587323 6416 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:34185
I20260808 05:54:58.587347 6554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:34185 every 8 connection(s)
I20260808 05:54:58.588289 6416 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168498, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:58.598282 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 6416
I20260808 05:54:58.598413 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:54:58.598716 2813 external_mini_cluster.cc:1428] Setting key a7a5b4fa134e9c58a5686cb9d73d7e56
I20260808 05:54:58.602623 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:58.590357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:36873 (local address 127.2.191.126:39607)
0808 05:54:58.590494 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:58.590504 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:58.591379 (+ 875us) server_negotiation.cc:407] Connection header received
0808 05:54:58.592821 (+ 1442us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:58.592824 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:58.592875 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:58.592953 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:58.594144 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.594703 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.595859 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.596091 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.596176 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:58.598839 (+ 2663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:58.598842 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:58.598844 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:58.598871 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:58.600396 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.601019 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.601023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.601026 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.601119 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.601476 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.601480 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.601483 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.601701 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:58.601812 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:58.602330 (+ 518us) server_negotiation.cc:299] Negotiation successful
0808 05:54:58.602460 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:54:58.603494 6557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:58.590698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39607 (local address 127.2.191.66:36873)
0808 05:54:58.591217 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:58.591264 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:58.592535 (+ 1271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:58.593114 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:58.593121 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:58.593489 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:58.593995 (+ 506us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:58.594008 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.594822 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.594824 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:58.595737 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:58.595747 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.596230 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.596233 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:58.596374 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:58.596999 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:58.597016 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:58.598655 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:58.600530 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:58.600536 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:58.600561 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:58.600912 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:58.601217 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:58.601222 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:58.601224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:58.601376 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:58.601813 (+ 437us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:58.601822 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:58.602085 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 05:54:58.602285 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 05:54:58.602635 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":139,"threads_started":1}
I20260808 05:54:58.604851 6555 heartbeater.cc:347] Connected to a master server at 127.2.191.126:39607
I20260808 05:54:58.605114 6555 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:58.605625 6555 heartbeater.cc:511] Master 127.2.191.126:39607 requested a full tablet report, sending...
I20260808 05:54:58.606786 6200 ts_manager.cc:194] Registered new tserver with Master: 07ba85aa284442a1bcfaf5a0549cbe44 (127.2.191.66:34185)
I20260808 05:54:58.607363 6200 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:36873
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:54:58.632067 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39607
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:54:58.751353 6560 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:54:58.751633 6560 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:54:58.751678 6560 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:54:58.755941 6560 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:54:58.756019 6560 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:54:58.756083 6560 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:54:58.761636 6560 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:39607
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6560
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:54:58.762724 6560 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:54:58.763749 6560 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:54:58.774206 6565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:58.774199 6568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:54:58.774204 6566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:54:58.774327 6560 server_base.cc:1034] running on GCE node
I20260808 05:54:58.774976 6560 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:54:58.775650 6560 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:54:58.776825 6560 hybrid_clock.cc:648] HybridClock initialized: now 1786168498776809 us; error 29 us; skew 500 ppm
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168498, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:54:58.779773 6560 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:54:58.780689 6560 webserver.cc:460] Webserver started at http://127.2.191.67:41421/ using document root <none> and password file <none>
I20260808 05:54:58.781301 6560 fs_manager.cc:359] Metadata directory not provided
I20260808 05:54:58.781399 6560 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:54:58.781648 6560 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:54:58.783716 6560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "8676e2569203443aa3d02403ae302f7e"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "8ebcb4dfcfb992f7bd9ef63df827dce2"
server_key_iv: "6077be5f43abede274a3cac436d8934e"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.784292 6560 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "8676e2569203443aa3d02403ae302f7e"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "8ebcb4dfcfb992f7bd9ef63df827dce2"
server_key_iv: "6077be5f43abede274a3cac436d8934e"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.788314 6560 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.003s
I20260808 05:54:58.791134 6575 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.792538 6560 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:54:58.792687 6560 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "8676e2569203443aa3d02403ae302f7e"
format_stamp: "Formatted at 2026-08-08 05:54:58 on dist-test-slave-qg60"
server_key: "8ebcb4dfcfb992f7bd9ef63df827dce2"
server_key_iv: "6077be5f43abede274a3cac436d8934e"
server_key_version: "encryptionkey@0"
I20260808 05:54:58.792865 6560 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:54:58.810688 6560 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:54:58.813908 6560 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:54:58.814134 6560 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:54:58.814779 6560 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:54:58.815666 6560 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:54:58.815740 6560 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.815815 6560 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:54:58.815860 6560 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:54:58.826184 6560 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:42975
I20260808 05:54:58.826207 6704 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:42975 every 8 connection(s)
I20260808 05:54:58.827121 6560 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:54:58.830094 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 6560
I20260808 05:54:58.830241 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:54:58.830618 2813 external_mini_cluster.cc:1428] Setting key a4969ef5e593b8dd97b4dc17d20df6c8
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168498, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:58.842183 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:58.829215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:56165 (local address 127.2.191.126:39607)
0808 05:54:58.829377 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:58.829381 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:58.830448 (+ 1067us) server_negotiation.cc:407] Connection header received
0808 05:54:58.832304 (+ 1856us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:58.832310 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:58.832367 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:58.832456 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:58.833885 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.834426 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.835526 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.835746 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.835824 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:58.838498 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:58.838501 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:58.838503 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:58.838529 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:58.840197 (+ 1668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.840713 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.840716 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.840717 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.840854 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.841177 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.841179 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.841180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.841361 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:58.841438 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:58.841939 (+ 501us) server_negotiation.cc:299] Negotiation successful
0808 05:54:58.842048 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 05:54:58.843170 6707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:58.829652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39607 (local address 127.2.191.67:56165)
0808 05:54:58.830248 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 05:54:58.830312 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0808 05:54:58.832041 (+ 1729us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:54:58.832619 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:54:58.832626 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:54:58.833248 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:54:58.833749 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:58.833764 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.834539 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.834542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:58.835418 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:54:58.835427 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.835876 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.835879 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:54:58.836021 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:58.836717 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:54:58.836789 (+ 72us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:54:58.838330 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:54:58.840320 (+ 1990us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:58.840325 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:58.840338 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:58.840621 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:58.840943 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:54:58.840945 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:54:58.840946 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:54:58.841091 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:54:58.841461 (+ 370us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:54:58.841466 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:54:58.841717 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 05:54:58.841890 (+ 173us) client_negotiation.cc:240] Negotiation successful
0808 05:54:58.842278 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":123,"threads_started":1}
I20260808 05:54:58.844538 6705 heartbeater.cc:347] Connected to a master server at 127.2.191.126:39607
I20260808 05:54:58.844856 6705 heartbeater.cc:464] Registering TS with master...
I20260808 05:54:58.845489 6705 heartbeater.cc:511] Master 127.2.191.126:39607 requested a full tablet report, sending...
I20260808 05:54:58.846735 6199 ts_manager.cc:194] Registered new tserver with Master: 8676e2569203443aa3d02403ae302f7e (127.2.191.67:42975)
I20260808 05:54:58.847399 6199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:56165
I20260808 05:54:58.857635 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168498, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6153](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168498, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:54:58.886255 6241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:54:58.877284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40698 (local address 127.2.191.126:39607)
0808 05:54:58.877483 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 05:54:58.877488 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:54:58.877636 (+ 148us) server_negotiation.cc:407] Connection header received
0808 05:54:58.877813 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:54:58.877817 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:54:58.877874 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:54:58.877968 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:54:58.878728 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.879306 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.880191 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:54:58.880421 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:54:58.880530 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:54:58.883018 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:54:58.883021 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:54:58.883023 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:54:58.883053 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:54:58.884348 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.884910 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.884915 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.884917 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.885007 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:54:58.885301 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:54:58.885304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:54:58.885306 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:54:58.885555 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:54:58.885704 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 05:54:58.885946 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 05:54:58.886076 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
W20260808 05:54:58.886682 6199 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:40698
I20260808 05:54:58.887571 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 6267
I20260808 05:54:58.896427 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 6416
I20260808 05:54:58.903532 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 6560
I20260808 05:54:58.910706 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 6167
2026-08-08T05:54:58Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2375 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6718](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6718](info): set up 2 sockets
Aug 08 05:54:58 dist-test-slave-qg60 krb5kdc[6718](info): commencing operation
krb5kdc: starting...
W20260808 05:55:00.027261 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:00 dist-test-slave-qg60 krb5kdc[6718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:55:00.164255 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42947
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:42947
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:00.288961 6733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:00.289403 6733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:00.289505 6733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:00.294327 6733 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:00.294445 6733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:00.294485 6733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:00.294535 6733 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:00.294577 6733 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:00.301175 6733 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:42947
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42947
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:00.302469 6733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:00.303644 6733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:00.313355 6739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:00.313378 6742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:00.313374 6740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:00.313432 6733 server_base.cc:1034] running on GCE node
I20260808 05:55:00.314251 6733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:00.315465 6733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:00.316666 6733 hybrid_clock.cc:648] HybridClock initialized: now 1786168500316634 us; error 49 us; skew 500 ppm
Aug 08 05:55:00 dist-test-slave-qg60 krb5kdc[6718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168500, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:00.319641 6733 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:55:00.320505 6733 webserver.cc:460] Webserver started at http://127.2.191.126:33037/ using document root <none> and password file <none>
I20260808 05:55:00.321192 6733 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:00.321290 6733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:00.321511 6733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:00.323736 6733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "ec8c7db220f44510bf0e62229152c3a2"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "c66da65344f89dd1020743d8a0d94620"
server_key_iv: "58698e5b6cd86a302b38468f753ddb24"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.324290 6733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "ec8c7db220f44510bf0e62229152c3a2"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "c66da65344f89dd1020743d8a0d94620"
server_key_iv: "58698e5b6cd86a302b38468f753ddb24"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.328238 6733 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:55:00.330919 6751 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:00.332326 6733 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:00.332445 6733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "ec8c7db220f44510bf0e62229152c3a2"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "c66da65344f89dd1020743d8a0d94620"
server_key_iv: "58698e5b6cd86a302b38468f753ddb24"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.332553 6733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:00.343839 6733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:00.347460 6733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:00.347643 6733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:00.355765 6733 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:42947
I20260808 05:55:00.355798 6812 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:42947 every 8 connection(s)
I20260808 05:55:00.356812 6733 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:00.359810 6813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:00.362223 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 6733
I20260808 05:55:00.362340 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:00.362653 2813 external_mini_cluster.cc:1428] Setting key ec478c796ed2b7fb282d69f28af36c0a
I20260808 05:55:00.366312 6813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2: Bootstrap starting.
I20260808 05:55:00.368650 6813 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:00.369482 6813 log.cc:824] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2: Log is configured to *not* fsync() on all Append() calls
Aug 08 05:55:00 dist-test-slave-qg60 krb5kdc[6718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168500, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:00.371791 6813 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2: No bootstrap required, opened a new log
I20260808 05:55:00.375876 6813 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8c7db220f44510bf0e62229152c3a2" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42947 } }
I20260808 05:55:00.376194 6813 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:00.376272 6813 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec8c7db220f44510bf0e62229152c3a2, State: Initialized, Role: FOLLOWER
I20260808 05:55:00.376840 6813 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8c7db220f44510bf0e62229152c3a2" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42947 } }
I20260808 05:55:00.377004 6813 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:00.377077 6813 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:00.377175 6813 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:00.377441 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:00.364192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46654 (local address 127.2.191.126:42947)
0808 05:55:00.364684 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:00.364700 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:00.364805 (+ 105us) server_negotiation.cc:407] Connection header received
0808 05:55:00.365468 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:00.365487 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:00.365826 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:00.366185 (+ 359us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:00.367010 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.368034 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.369060 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.369533 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.369716 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:00.372331 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:00.372336 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:00.372350 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:00.372378 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:00.374171 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:00.374709 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:00.374714 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:00.374720 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:00.374837 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:00.375146 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:00.375150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:00.375152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:00.375567 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:00.375805 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:00.376122 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 05:55:00.376465 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":164,"threads_started":1}
I20260808 05:55:00.378430 6813 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8c7db220f44510bf0e62229152c3a2" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42947 } }
I20260808 05:55:00.378793 6813 leader_election.cc:302] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec8c7db220f44510bf0e62229152c3a2; no voters:
I20260808 05:55:00.379109 6813 leader_election.cc:288] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:00.379276 6820 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:00.379544 6820 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [term 1 LEADER]: Becoming Leader. State: Replica: ec8c7db220f44510bf0e62229152c3a2, State: Running, Role: LEADER
I20260808 05:55:00.379952 6820 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8c7db220f44510bf0e62229152c3a2" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42947 } }
I20260808 05:55:00.380481 6813 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:00.381765 6822 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec8c7db220f44510bf0e62229152c3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8c7db220f44510bf0e62229152c3a2" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42947 } } }
I20260808 05:55:00.381908 6822 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:00.382296 6823 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec8c7db220f44510bf0e62229152c3a2. Latest consensus state: current_term: 1 leader_uuid: "ec8c7db220f44510bf0e62229152c3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec8c7db220f44510bf0e62229152c3a2" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42947 } } }
I20260808 05:55:00.382472 6823 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:00.383157 6830 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:00.386478 6830 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:00.392990 6830 catalog_manager.cc:1347] Generated new cluster ID: 7419c93006654948a054c94e86a8c632
I20260808 05:55:00.393102 6830 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:00.409345 6830 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:00.410660 6830 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:00.424300 6830 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec8c7db220f44510bf0e62229152c3a2: Generated new TSK 0
I20260808 05:55:00.425208 6830 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:55:00.464059 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42947
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:00.582779 6843 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:00.583065 6843 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:00.583109 6843 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:00.587309 6843 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:00.587379 6843 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:00.587438 6843 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:00.592990 6843 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6843
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:00.594070 6843 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:00.595077 6843 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:00.605662 6850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:00.605702 6852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:00.605691 6849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:00.606065 6843 server_base.cc:1034] running on GCE node
I20260808 05:55:00.606535 6843 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:00.607220 6843 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:00.608423 6843 hybrid_clock.cc:648] HybridClock initialized: now 1786168500608399 us; error 37 us; skew 500 ppm
Aug 08 05:55:00 dist-test-slave-qg60 krb5kdc[6718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168500, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:00.611575 6843 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:55:00.612524 6843 webserver.cc:460] Webserver started at http://127.2.191.65:37735/ using document root <none> and password file <none>
I20260808 05:55:00.613409 6843 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:00.613565 6843 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:00.613866 6843 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:00.616381 6843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "a9ecfff4d40e40889879114bc5c110ed"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "9db247af9a73882d784f0f90c9d34f5a"
server_key_iv: "0a698be5d855c2c7c31508b9ea1faf65"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.617148 6843 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "a9ecfff4d40e40889879114bc5c110ed"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "9db247af9a73882d784f0f90c9d34f5a"
server_key_iv: "0a698be5d855c2c7c31508b9ea1faf65"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.621820 6843 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 05:55:00.624634 6859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:00.626044 6843 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 05:55:00.626217 6843 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "a9ecfff4d40e40889879114bc5c110ed"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "9db247af9a73882d784f0f90c9d34f5a"
server_key_iv: "0a698be5d855c2c7c31508b9ea1faf65"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.626349 6843 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:00.653273 6843 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:00.656706 6843 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:00.656992 6843 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:00.657660 6843 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:00.658560 6843 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:00.658638 6843 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:00.658712 6843 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:00.658756 6843 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:00.667675 6843 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:38633
I20260808 05:55:00.667711 6989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:38633 every 8 connection(s)
I20260808 05:55:00.668592 6843 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:00.672230 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 6843
I20260808 05:55:00.672377 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:00.672698 2813 external_mini_cluster.cc:1428] Setting key b7986d85b059a207526525bae3f96570
Aug 08 05:55:00 dist-test-slave-qg60 krb5kdc[6718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168500, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:55:00.685536 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:00.670722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:39175 (local address 127.2.191.126:42947)
0808 05:55:00.670877 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:00.670881 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:00.671783 (+ 902us) server_negotiation.cc:407] Connection header received
0808 05:55:00.673537 (+ 1754us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:00.673540 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:00.673598 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:00.673689 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:00.675028 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.675573 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.677295 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.677550 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.677639 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:00.681427 (+ 3788us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:00.681430 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:00.681432 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:00.681459 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:00.683138 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:00.683790 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:00.683793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:00.683794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:00.683871 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:00.684311 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:00.684313 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:00.684315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:00.684529 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:00.684611 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:00.685281 (+ 670us) server_negotiation.cc:299] Negotiation successful
0808 05:55:00.685400 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 05:55:00.686530 6992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:00.671075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42947 (local address 127.2.191.65:39175)
0808 05:55:00.671601 (+ 526us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:00.671647 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:00.673267 (+ 1620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:00.673856 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:00.673863 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:00.674378 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:00.674872 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:00.674886 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.675745 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.675749 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:00.677160 (+ 1411us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:00.677174 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.677718 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.677725 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:00.677998 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:00.678837 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:00.678865 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:00.681210 (+ 2345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:00.683272 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:00.683280 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:00.683300 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:00.683681 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:00.683968 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:00.683973 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:00.683978 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:00.684201 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:00.684633 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:00.684639 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:00.684985 (+ 346us) client_negotiation.cc:769] Sending connection context
0808 05:55:00.685228 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 05:55:00.685517 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":126,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:55:00.688052 6990 heartbeater.cc:347] Connected to a master server at 127.2.191.126:42947
I20260808 05:55:00.688336 6990 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:00.688962 6990 heartbeater.cc:511] Master 127.2.191.126:42947 requested a full tablet report, sending...
I20260808 05:55:00.690613 6771 ts_manager.cc:194] Registered new tserver with Master: a9ecfff4d40e40889879114bc5c110ed (127.2.191.65:38633)
I20260808 05:55:00.691802 6771 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:39175
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:55:00.704877 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42947
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:00.830979 6996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:00.831279 6996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:00.831359 6996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:00.835736 6996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:00.835803 6996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:00.835865 6996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:00.841351 6996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:00.842525 6996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:00.843531 6996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:00.853545 7001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:00.853605 7004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:00.853566 7002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:00.853852 6996 server_base.cc:1034] running on GCE node
I20260808 05:55:00.854375 6996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:00.855013 6996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:00.856247 6996 hybrid_clock.cc:648] HybridClock initialized: now 1786168500856233 us; error 25 us; skew 500 ppm
Aug 08 05:55:00 dist-test-slave-qg60 krb5kdc[6718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168500, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:00.859685 6996 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:55:00.860659 6996 webserver.cc:460] Webserver started at http://127.2.191.66:35693/ using document root <none> and password file <none>
I20260808 05:55:00.861326 6996 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:00.861402 6996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:00.861685 6996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:00.863968 6996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "4cff0e8426584661995a9bbc77a1e2e6"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "525f52bef5b5a5f39b43ad2aa0a72bef"
server_key_iv: "0a8152e121663dd9fef6c9aa77c0bf5f"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.864676 6996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "4cff0e8426584661995a9bbc77a1e2e6"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "525f52bef5b5a5f39b43ad2aa0a72bef"
server_key_iv: "0a8152e121663dd9fef6c9aa77c0bf5f"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.868953 6996 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 05:55:00.871661 7013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:00.872943 6996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:00.873049 6996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "4cff0e8426584661995a9bbc77a1e2e6"
format_stamp: "Formatted at 2026-08-08 05:55:00 on dist-test-slave-qg60"
server_key: "525f52bef5b5a5f39b43ad2aa0a72bef"
server_key_iv: "0a8152e121663dd9fef6c9aa77c0bf5f"
server_key_version: "encryptionkey@0"
I20260808 05:55:00.873214 6996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:00.896008 6996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:00.899705 6996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:00.900015 6996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:00.900720 6996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:00.901669 6996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:00.901718 6996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:00.901784 6996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:00.901818 6996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:00.911576 6996 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:40017
I20260808 05:55:00.911640 7138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:40017 every 8 connection(s)
I20260808 05:55:00.912521 6996 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:00.913615 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 6996
I20260808 05:55:00.913712 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:00.914026 2813 external_mini_cluster.cc:1428] Setting key 78757894df9f8fd9b16987008a8d01c5
Aug 08 05:55:00 dist-test-slave-qg60 krb5kdc[6718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168500, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:55:00.929121 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:00.914542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:52115 (local address 127.2.191.126:42947)
0808 05:55:00.914685 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:00.914688 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:00.915975 (+ 1287us) server_negotiation.cc:407] Connection header received
0808 05:55:00.918237 (+ 2262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:00.918242 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:00.918316 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:00.918432 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:00.919785 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.920331 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.921726 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.921964 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.922085 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:00.925050 (+ 2965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:00.925053 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:00.925056 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:00.925085 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:00.926681 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:00.927331 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:00.927334 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:00.927335 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:00.927419 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:00.927770 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:00.927773 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:00.927774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:00.927969 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:00.928109 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:00.928803 (+ 694us) server_negotiation.cc:299] Negotiation successful
0808 05:55:00.928934 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:55:00.930385 7141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:00.915021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42947 (local address 127.2.191.66:52115)
0808 05:55:00.915814 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:00.915877 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:00.917874 (+ 1997us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:00.918650 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:00.918658 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:00.919048 (+ 390us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:00.919605 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:00.919620 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.920478 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.920487 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:00.921571 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:00.921582 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:00.922143 (+ 561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:00.922147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:00.922322 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:00.923004 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:00.923022 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:00.924855 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:00.926822 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:00.926829 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:00.926846 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:00.927133 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:00.927509 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:00.927512 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:00.927513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:00.927668 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:00.928146 (+ 478us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:00.928152 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:00.928451 (+ 299us) client_negotiation.cc:769] Sending connection context
0808 05:55:00.928672 (+ 221us) client_negotiation.cc:240] Negotiation successful
0808 05:55:00.929116 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":160,"threads_started":1}
I20260808 05:55:00.931885 7139 heartbeater.cc:347] Connected to a master server at 127.2.191.126:42947
I20260808 05:55:00.932199 7139 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:00.932785 7139 heartbeater.cc:511] Master 127.2.191.126:42947 requested a full tablet report, sending...
I20260808 05:55:00.933934 6771 ts_manager.cc:194] Registered new tserver with Master: 4cff0e8426584661995a9bbc77a1e2e6 (127.2.191.66:40017)
I20260808 05:55:00.934541 6771 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:52115
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:55:00.947444 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42947
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:36117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:01.065068 7144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:01.065353 7144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:01.065398 7144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:01.069531 7144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:01.069604 7144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:01.069666 7144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:01.075193 7144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42947
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7144
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:01.076479 7144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:01.077785 7144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:01.087993 7152 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:01.087993 7149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:01.087997 7150 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:01.088446 7144 server_base.cc:1034] running on GCE node
I20260808 05:55:01.088954 7144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:01.089614 7144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:01.090832 7144 hybrid_clock.cc:648] HybridClock initialized: now 1786168501090797 us; error 54 us; skew 500 ppm
Aug 08 05:55:01 dist-test-slave-qg60 krb5kdc[6718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168501, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:01.094004 7144 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:55:01.095072 7144 webserver.cc:460] Webserver started at http://127.2.191.67:40225/ using document root <none> and password file <none>
I20260808 05:55:01.095675 7144 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:01.095770 7144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:01.096015 7144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:01.098299 7144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "2b39cdf343bf4d499bacac5ba58e96e8"
format_stamp: "Formatted at 2026-08-08 05:55:01 on dist-test-slave-qg60"
server_key: "0569328b1ee776e9b465449f1277ac49"
server_key_iv: "11e657c9e58dc1d4f153634b63bee26c"
server_key_version: "encryptionkey@0"
I20260808 05:55:01.098907 7144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "2b39cdf343bf4d499bacac5ba58e96e8"
format_stamp: "Formatted at 2026-08-08 05:55:01 on dist-test-slave-qg60"
server_key: "0569328b1ee776e9b465449f1277ac49"
server_key_iv: "11e657c9e58dc1d4f153634b63bee26c"
server_key_version: "encryptionkey@0"
I20260808 05:55:01.102979 7144 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:01.105705 7160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:01.107089 7144 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:01.107264 7144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "2b39cdf343bf4d499bacac5ba58e96e8"
format_stamp: "Formatted at 2026-08-08 05:55:01 on dist-test-slave-qg60"
server_key: "0569328b1ee776e9b465449f1277ac49"
server_key_iv: "11e657c9e58dc1d4f153634b63bee26c"
server_key_version: "encryptionkey@0"
I20260808 05:55:01.107400 7144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:01.129300 7144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:01.132514 7144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:01.132776 7144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:01.133419 7144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:01.134289 7144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:01.134364 7144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:01.134436 7144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:01.134487 7144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:01.144192 7144 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:36351
I20260808 05:55:01.144218 7285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:36351 every 8 connection(s)
I20260808 05:55:01.145203 7144 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:55:01 dist-test-slave-qg60 krb5kdc[6718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168501, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:01.155496 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 7144
I20260808 05:55:01.155675 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:01.155982 2813 external_mini_cluster.cc:1428] Setting key 2f4318a134cd5cc39e4f6eb5385d8663
I20260808 05:55:01.160220 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:01.147241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:60871 (local address 127.2.191.126:42947)
0808 05:55:01.147406 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:01.147410 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:01.148179 (+ 769us) server_negotiation.cc:407] Connection header received
0808 05:55:01.149687 (+ 1508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:01.149690 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:01.149751 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:01.149864 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:01.151152 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:01.151729 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:01.152976 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:01.153208 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:01.153321 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:01.156260 (+ 2939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:01.156263 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:01.156265 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:01.156293 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:01.157977 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:01.158553 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:01.158556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:01.158558 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:01.158648 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:01.159026 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:01.159032 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:01.159037 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:01.159242 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:01.159357 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:01.159917 (+ 560us) server_negotiation.cc:299] Negotiation successful
0808 05:55:01.160051 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 05:55:01.161197 7288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:01.147578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42947 (local address 127.2.191.67:60871)
0808 05:55:01.148018 (+ 440us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:01.148063 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:01.149451 (+ 1388us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:01.150073 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:01.150080 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:01.150469 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:01.150973 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:01.150988 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:01.151867 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:01.151870 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:01.152830 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:01.152840 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:01.153383 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:01.153388 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:01.153574 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:01.154244 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:01.154261 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:01.156042 (+ 1781us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:01.158116 (+ 2074us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:01.158123 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:01.158141 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:01.158438 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:01.158749 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:01.158753 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:01.158754 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:01.158924 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:01.159355 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:01.159362 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:01.159655 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 05:55:01.159859 (+ 204us) client_negotiation.cc:240] Negotiation successful
0808 05:55:01.160229 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":109,"threads_started":1}
I20260808 05:55:01.162384 7286 heartbeater.cc:347] Connected to a master server at 127.2.191.126:42947
I20260808 05:55:01.162657 7286 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:01.163201 7286 heartbeater.cc:511] Master 127.2.191.126:42947 requested a full tablet report, sending...
I20260808 05:55:01.164367 6771 ts_manager.cc:194] Registered new tserver with Master: 2b39cdf343bf4d499bacac5ba58e96e8 (127.2.191.67:36351)
I20260808 05:55:01.165057 6771 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:60871
I20260808 05:55:01.170186 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:55:01 dist-test-slave-qg60 krb5kdc[6718](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:55:01 dist-test-slave-qg60 krb5kdc[6718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:55:01.199672 7294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:01.188972 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51078 (local address 127.2.191.65:38633)
0808 05:55:01.189337 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:01.189345 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:01.189375 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:55:01.189440 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:01.189454 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:01.189661 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:01.189826 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:01.190567 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:01.191339 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:01.192215 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:01.192610 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:01.192731 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:01.195212 (+ 2481us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:01.195222 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:01.195236 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:01.195261 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:01.197142 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:01.197687 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:01.197709 (+ 22us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:01.197713 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:01.197821 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:01.198216 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:01.198221 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:01.198224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:01.198653 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:01.198884 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:01.199275 (+ 391us) server_negotiation.cc:299] Negotiation successful
0808 05:55:01.199448 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":146,"threads_started":1}
Aug 08 05:55:01 dist-test-slave-qg60 krb5kdc[6718](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168501, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:01.212123 6816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:01.203204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46668 (local address 127.2.191.126:42947)
0808 05:55:01.203341 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:01.203346 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:01.203494 (+ 148us) server_negotiation.cc:407] Connection header received
0808 05:55:01.203655 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:01.203663 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:01.203709 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:01.203800 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:01.204479 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:01.205087 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:01.205890 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:01.206119 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:01.206230 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:01.208899 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:01.208903 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:01.208906 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:01.208948 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:01.210288 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:01.210774 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:01.210777 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:01.210779 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:01.210868 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:01.211154 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:01.211157 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:01.211159 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:01.211412 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:01.211562 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:01.211814 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 05:55:01.211939 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 05:55:01.212572 6771 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46668
I20260808 05:55:01.213397 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 6843
I20260808 05:55:01.222422 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 6996
I20260808 05:55:01.229895 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 7144
I20260808 05:55:01.237143 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 6733
2026-08-08T05:55:01Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2326 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:55:01 dist-test-slave-qg60 krb5kdc[7299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:55:01 dist-test-slave-qg60 krb5kdc[7299](info): set up 2 sockets
Aug 08 05:55:01 dist-test-slave-qg60 krb5kdc[7299](info): commencing operation
krb5kdc: starting...
W20260808 05:55:02.333001 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:02 dist-test-slave-qg60 krb5kdc[7299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:55:02.471551 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33337
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:33337
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:02.590716 7314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:02.591001 7314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:02.591046 7314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:02.595151 7314 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:02.595219 7314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:02.595244 7314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:02.595260 7314 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:02.595276 7314 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:02.600621 7314 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:33337
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33337
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7314
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:02.601771 7314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:02.602768 7314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:02.611639 7321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:02.611766 7314 server_base.cc:1034] running on GCE node
W20260808 05:55:02.611661 7323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:02.611639 7320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:02.612540 7314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:02.613850 7314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:02.615070 7314 hybrid_clock.cc:648] HybridClock initialized: now 1786168502615025 us; error 53 us; skew 500 ppm
Aug 08 05:55:02 dist-test-slave-qg60 krb5kdc[7299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168502, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:02.628187 7314 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:55:02.629261 7314 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:02.629369 7314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:02.629611 7314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:02.631836 7314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "44836a2cf7fa41b089712277a2e91c4a"
format_stamp: "Formatted at 2026-08-08 05:55:02 on dist-test-slave-qg60"
server_key: "dd8e82c54ed0047a616502eba0367746"
server_key_iv: "647e3b1b5189353e01d03a2650639609"
server_key_version: "encryptionkey@0"
I20260808 05:55:02.632458 7314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "44836a2cf7fa41b089712277a2e91c4a"
format_stamp: "Formatted at 2026-08-08 05:55:02 on dist-test-slave-qg60"
server_key: "dd8e82c54ed0047a616502eba0367746"
server_key_iv: "647e3b1b5189353e01d03a2650639609"
server_key_version: "encryptionkey@0"
I20260808 05:55:02.636475 7314 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:55:02.639240 7329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:02.640565 7314 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:02.640765 7314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "44836a2cf7fa41b089712277a2e91c4a"
format_stamp: "Formatted at 2026-08-08 05:55:02 on dist-test-slave-qg60"
server_key: "dd8e82c54ed0047a616502eba0367746"
server_key_iv: "647e3b1b5189353e01d03a2650639609"
server_key_version: "encryptionkey@0"
I20260808 05:55:02.640899 7314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:02.662756 7314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:02.666131 7314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:02.666368 7314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:02.674127 7314 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:33337
I20260808 05:55:02.674419 7388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:33337 every 8 connection(s)
I20260808 05:55:02.674883 7314 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:02.677942 7389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:02.679539 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 7314
I20260808 05:55:02.679697 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:02.679994 2813 external_mini_cluster.cc:1428] Setting key f7a4a8ef64fa2e504b4f28c18a1c5d6c
I20260808 05:55:02.685240 7389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a: Bootstrap starting.
I20260808 05:55:02.687992 7389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:02.688823 7389 log.cc:824] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a: Log is configured to *not* fsync() on all Append() calls
Aug 08 05:55:02 dist-test-slave-qg60 krb5kdc[7299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168502, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:02.691143 7389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a: No bootstrap required, opened a new log
I20260808 05:55:02.694907 7389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44836a2cf7fa41b089712277a2e91c4a" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33337 } }
I20260808 05:55:02.695281 7389 raft_consensus.cc:374] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:02.695360 7389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 44836a2cf7fa41b089712277a2e91c4a, State: Initialized, Role: FOLLOWER
I20260808 05:55:02.695904 7389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44836a2cf7fa41b089712277a2e91c4a" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33337 } }
I20260808 05:55:02.696067 7389 raft_consensus.cc:388] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:02.696149 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:02.681556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39574 (local address 127.2.191.126:33337)
0808 05:55:02.682016 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:02.682036 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:02.682081 (+ 45us) server_negotiation.cc:407] Connection header received
0808 05:55:02.682924 (+ 843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:02.682948 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:02.683384 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:02.683776 (+ 392us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:02.684498 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:02.685974 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:02.686909 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:02.687597 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:02.687759 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:02.690973 (+ 3214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:02.690979 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:02.690993 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:02.691021 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:02.692899 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:02.693378 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:02.693391 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:02.693396 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:02.693516 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:02.693821 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:02.693826 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:02.693828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:02.694240 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:02.694470 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:02.694719 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 05:55:02.695085 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":106,"threads_started":1}
I20260808 05:55:02.696161 7389 raft_consensus.cc:482] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:02.696326 7389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:02.697626 7389 raft_consensus.cc:504] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44836a2cf7fa41b089712277a2e91c4a" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33337 } }
I20260808 05:55:02.697980 7389 leader_election.cc:302] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 44836a2cf7fa41b089712277a2e91c4a; no voters:
I20260808 05:55:02.698303 7389 leader_election.cc:288] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:02.698516 7396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:02.698804 7396 raft_consensus.cc:686] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [term 1 LEADER]: Becoming Leader. State: Replica: 44836a2cf7fa41b089712277a2e91c4a, State: Running, Role: LEADER
I20260808 05:55:02.699155 7396 consensus_queue.cc:237] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44836a2cf7fa41b089712277a2e91c4a" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33337 } }
I20260808 05:55:02.699610 7389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:02.700958 7397 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "44836a2cf7fa41b089712277a2e91c4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44836a2cf7fa41b089712277a2e91c4a" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33337 } } }
I20260808 05:55:02.701102 7397 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:02.701488 7398 sys_catalog.cc:455] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 44836a2cf7fa41b089712277a2e91c4a. Latest consensus state: current_term: 1 leader_uuid: "44836a2cf7fa41b089712277a2e91c4a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "44836a2cf7fa41b089712277a2e91c4a" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33337 } } }
I20260808 05:55:02.701684 7398 sys_catalog.cc:458] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a [sys.catalog]: This master's current role is: LEADER
W20260808 05:55:02.704989 7412 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:55:02.705087 7412 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:55:02.705149 7406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:02.705849 7406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:02.711850 7406 catalog_manager.cc:1347] Generated new cluster ID: 9f6cca97707a4003b78fd600b4b8637b
I20260808 05:55:02.711933 7406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:02.730432 7406 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:02.731479 7406 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:02.741485 7406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a: Generated new TSK 0
I20260808 05:55:02.742380 7406 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:55:02.788647 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33337
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:02.907306 7418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:02.907774 7418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:02.907879 7418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:02.912307 7418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:02.912376 7418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:02.912475 7418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:02.918244 7418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:02.919384 7418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:02.920513 7418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:02.931041 7426 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:02.930996 7424 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:02.930991 7423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:02.931129 7418 server_base.cc:1034] running on GCE node
I20260808 05:55:02.931794 7418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:02.932513 7418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:02.933681 7418 hybrid_clock.cc:648] HybridClock initialized: now 1786168502933663 us; error 39 us; skew 500 ppm
Aug 08 05:55:02 dist-test-slave-qg60 krb5kdc[7299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168502, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:02.936960 7418 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:55:02.937848 7418 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:02.937947 7418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:02.938205 7418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:02.940380 7418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4"
format_stamp: "Formatted at 2026-08-08 05:55:02 on dist-test-slave-qg60"
server_key: "6a8360ea9ade50c4dfa558fa76bbff13"
server_key_iv: "a6bf2c7dab778562b196b443a0a227dd"
server_key_version: "encryptionkey@0"
I20260808 05:55:02.941020 7418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4"
format_stamp: "Formatted at 2026-08-08 05:55:02 on dist-test-slave-qg60"
server_key: "6a8360ea9ade50c4dfa558fa76bbff13"
server_key_iv: "a6bf2c7dab778562b196b443a0a227dd"
server_key_version: "encryptionkey@0"
I20260808 05:55:02.944959 7418 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 05:55:02.947849 7433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:02.949324 7418 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:02.949476 7418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4"
format_stamp: "Formatted at 2026-08-08 05:55:02 on dist-test-slave-qg60"
server_key: "6a8360ea9ade50c4dfa558fa76bbff13"
server_key_iv: "a6bf2c7dab778562b196b443a0a227dd"
server_key_version: "encryptionkey@0"
I20260808 05:55:02.949601 7418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:02.961360 7418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:02.964627 7418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:02.964880 7418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:02.965507 7418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:02.966392 7418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:02.966466 7418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:02.966539 7418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:02.966576 7418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:02.975975 7418 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:42369
I20260808 05:55:02.975992 7560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:42369 every 8 connection(s)
I20260808 05:55:02.976641 7418 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:02.986775 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 7418
I20260808 05:55:02.986919 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
Aug 08 05:55:02 dist-test-slave-qg60 krb5kdc[7299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168502, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:02.987270 2813 external_mini_cluster.cc:1428] Setting key 40a94ac0b0f47aeef58f72d05c91d539
I20260808 05:55:02.992123 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:02.978728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:53579 (local address 127.2.191.126:33337)
0808 05:55:02.978883 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:02.978887 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:02.979855 (+ 968us) server_negotiation.cc:407] Connection header received
0808 05:55:02.981547 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:02.981551 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:02.981613 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:02.981726 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:02.982938 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:02.983509 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:02.984677 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:02.984983 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:02.985108 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:02.988123 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:02.988127 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:02.988129 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:02.988158 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:02.989842 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:02.990474 (+ 632us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:02.990478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:02.990479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:02.990564 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:02.990942 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:02.990949 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:02.990953 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:02.991158 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:02.991274 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:02.991807 (+ 533us) server_negotiation.cc:299] Negotiation successful
0808 05:55:02.991950 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 05:55:02.993141 7563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:02.979175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33337 (local address 127.2.191.65:53579)
0808 05:55:02.979690 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:02.979736 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:02.981286 (+ 1550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:02.981917 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:02.981924 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:02.982298 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:02.982785 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:02.982798 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:02.983646 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:02.983649 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:02.984529 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:02.984538 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:02.985145 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:02.985149 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:02.985340 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:02.985917 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:02.985937 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:02.987824 (+ 1887us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:02.989984 (+ 2160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:02.989990 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:02.990009 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:02.990313 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:02.990667 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:02.990670 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:02.990672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:02.990838 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:02.991272 (+ 434us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:02.991279 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:02.991556 (+ 277us) client_negotiation.cc:769] Sending connection context
0808 05:55:02.991765 (+ 209us) client_negotiation.cc:240] Negotiation successful
0808 05:55:02.992146 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":140,"threads_started":1}
I20260808 05:55:02.994807 7561 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33337
I20260808 05:55:02.995121 7561 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:02.995671 7561 heartbeater.cc:511] Master 127.2.191.126:33337 requested a full tablet report, sending...
I20260808 05:55:02.997502 7349 ts_manager.cc:194] Registered new tserver with Master: 92b9ecdb8ffb42ec932bee1c5d4bbfd4 (127.2.191.65:42369)
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:55:02.998783 7349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:53579
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:55:03.020363 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33337
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:03.138237 7566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:03.138556 7566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:03.138644 7566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:03.142717 7566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:03.142822 7566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:03.142923 7566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:03.148577 7566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:03.149746 7566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:03.150799 7566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:03.161235 7571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:03.161381 7566 server_base.cc:1034] running on GCE node
W20260808 05:55:03.161275 7572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:03.161235 7574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:03.162125 7566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:03.162822 7566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:03.164026 7566 hybrid_clock.cc:648] HybridClock initialized: now 1786168503164007 us; error 34 us; skew 500 ppm
Aug 08 05:55:03 dist-test-slave-qg60 krb5kdc[7299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168503, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:03.167128 7566 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:55:03.167915 7566 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:03.168017 7566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:03.168269 7566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:03.170521 7566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "c20bcc47d5df434d8741db3b172ae78c"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "cad8fafb1aff0ca0a9bb224659dc9ef0"
server_key_iv: "bb900c2fe1f831c436ca5ad4bcd7de28"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.171125 7566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "c20bcc47d5df434d8741db3b172ae78c"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "cad8fafb1aff0ca0a9bb224659dc9ef0"
server_key_iv: "bb900c2fe1f831c436ca5ad4bcd7de28"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.175150 7566 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:03.177778 7582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:03.179137 7566 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:03.179292 7566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "c20bcc47d5df434d8741db3b172ae78c"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "cad8fafb1aff0ca0a9bb224659dc9ef0"
server_key_iv: "bb900c2fe1f831c436ca5ad4bcd7de28"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.179422 7566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:03.201627 7566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:03.205612 7566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:03.205835 7566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:03.206581 7566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:03.207670 7566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:03.207755 7566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:03.207823 7566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:03.207854 7566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:03.217301 7566 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:34689
I20260808 05:55:03.217317 7709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:34689 every 8 connection(s)
I20260808 05:55:03.217963 7566 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:55:03 dist-test-slave-qg60 krb5kdc[7299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168503, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:03.228228 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 7566
I20260808 05:55:03.228359 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:03.228775 2813 external_mini_cluster.cc:1428] Setting key e0f2d0d130d5268a8391086c73f6b4da
I20260808 05:55:03.233120 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.219927 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:57257 (local address 127.2.191.126:33337)
0808 05:55:03.220080 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.220084 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.220985 (+ 901us) server_negotiation.cc:407] Connection header received
0808 05:55:03.222433 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.222437 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.222501 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.222589 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:03.223800 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.224345 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.225597 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.225824 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.225942 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.228772 (+ 2830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:03.228777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:03.228780 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:03.228814 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:03.230570 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:03.231243 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:03.231246 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:03.231247 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:03.231329 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:03.231732 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:03.231734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:03.231735 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:03.231916 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:03.231995 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.232709 (+ 714us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.232899 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:55:03.233954 7712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.220276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33337 (local address 127.2.191.66:57257)
0808 05:55:03.220835 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.220880 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:03.222197 (+ 1317us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:03.222762 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:03.222769 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:03.223150 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:03.223642 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.223656 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.224482 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.224491 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.225444 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.225455 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.225986 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.225991 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.226170 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.226816 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:03.226832 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:03.228465 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:03.230691 (+ 2226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:03.230697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:03.230713 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:03.231139 (+ 426us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:03.231420 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:03.231426 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:03.231432 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:03.231637 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:03.232022 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:03.232032 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:03.232396 (+ 364us) client_negotiation.cc:769] Sending connection context
0808 05:55:03.232626 (+ 230us) client_negotiation.cc:240] Negotiation successful
0808 05:55:03.233007 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"thread_start_us":133,"threads_started":1}
I20260808 05:55:03.235251 7710 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33337
I20260808 05:55:03.235541 7710 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:03.236217 7710 heartbeater.cc:511] Master 127.2.191.126:33337 requested a full tablet report, sending...
I20260808 05:55:03.237438 7349 ts_manager.cc:194] Registered new tserver with Master: c20bcc47d5df434d8741db3b172ae78c (127.2.191.66:34689)
I20260808 05:55:03.238032 7349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:57257
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:55:03.260667 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33337
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40687
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:03.377064 7715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:03.377419 7715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:03.377507 7715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:03.382040 7715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:03.382145 7715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:03.382241 7715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:03.387898 7715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40687
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:03.389092 7715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:03.390148 7715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:03.399966 7724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:03.400158 7715 server_base.cc:1034] running on GCE node
W20260808 05:55:03.399959 7722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:03.399976 7721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:03.400839 7715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:03.401594 7715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:03.402792 7715 hybrid_clock.cc:648] HybridClock initialized: now 1786168503402713 us; error 103 us; skew 500 ppm
Aug 08 05:55:03 dist-test-slave-qg60 krb5kdc[7299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168503, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:03.405774 7715 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:55:03.406560 7715 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:03.406628 7715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:03.406802 7715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:03.409147 7715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "ab8837c258ef4475b9e8a0869bf1f8b1"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "2e8b3d7d4c3e32031bff740629489640"
server_key_iv: "5b6122bd9eaebf0c355d5d598839a918"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.409701 7715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "ab8837c258ef4475b9e8a0869bf1f8b1"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "2e8b3d7d4c3e32031bff740629489640"
server_key_iv: "5b6122bd9eaebf0c355d5d598839a918"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.413492 7715 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:55:03.416070 7730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:03.417498 7715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:03.417632 7715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "ab8837c258ef4475b9e8a0869bf1f8b1"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "2e8b3d7d4c3e32031bff740629489640"
server_key_iv: "5b6122bd9eaebf0c355d5d598839a918"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.417747 7715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:03.440147 7715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:03.443857 7715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:03.444104 7715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:03.444808 7715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:03.445780 7715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:03.445832 7715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:03.445904 7715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:03.445946 7715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:03.455667 7715 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:35473
I20260808 05:55:03.455685 7855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:35473 every 8 connection(s)
I20260808 05:55:03.456322 7715 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:03.458768 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 7715
I20260808 05:55:03.458928 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:03.459287 2813 external_mini_cluster.cc:1428] Setting key 04a117576614182931d55e2c0362bc6a
Aug 08 05:55:03 dist-test-slave-qg60 krb5kdc[7299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168503, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:03.470669 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.458234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:48115 (local address 127.2.191.126:33337)
0808 05:55:03.458386 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.458390 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.459278 (+ 888us) server_negotiation.cc:407] Connection header received
0808 05:55:03.460988 (+ 1710us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.460991 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.461043 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.461139 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:03.462481 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.463024 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.464186 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.464404 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.464492 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.467080 (+ 2588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:03.467083 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:03.467085 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:03.467112 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:03.468633 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:03.469209 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:03.469213 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:03.469214 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:03.469307 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:03.469611 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:03.469614 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:03.469615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:03.469803 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:03.469881 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.470402 (+ 521us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.470517 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:55:03.471473 7858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.458614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33337 (local address 127.2.191.67:48115)
0808 05:55:03.459104 (+ 490us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.459158 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:03.460769 (+ 1611us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:03.461285 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:03.461292 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:03.461786 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:03.462326 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.462339 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.463165 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.463168 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.464035 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.464045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.464542 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.464544 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.464711 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.465421 (+ 710us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:03.465437 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:03.466912 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:03.468809 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:03.468814 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:03.468827 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:03.469099 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:03.469395 (+ 296us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:03.469397 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:03.469399 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:03.469530 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:03.469894 (+ 364us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:03.469899 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:03.470174 (+ 275us) client_negotiation.cc:769] Sending connection context
0808 05:55:03.470337 (+ 163us) client_negotiation.cc:240] Negotiation successful
0808 05:55:03.470598 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":142,"threads_started":1}
I20260808 05:55:03.472671 7856 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33337
I20260808 05:55:03.472977 7856 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:03.473637 7856 heartbeater.cc:511] Master 127.2.191.126:33337 requested a full tablet report, sending...
I20260808 05:55:03.474689 7349 ts_manager.cc:194] Registered new tserver with Master: ab8837c258ef4475b9e8a0869bf1f8b1 (127.2.191.67:35473)
I20260808 05:55:03.475301 7349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:48115
I20260808 05:55:03.485764 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:55:03.496024 7393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.488089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37886 (local address 127.2.191.126:33337)
0808 05:55:03.488257 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.488262 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.488349 (+ 87us) server_negotiation.cc:407] Connection header received
0808 05:55:03.488525 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.488529 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.488574 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.488664 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:03.489470 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.490008 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.490908 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.491139 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.491255 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.492762 (+ 1507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:03.492766 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:03.492769 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:03.492806 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:03.494159 (+ 1353us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:03.494601 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:03.494608 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:03.494611 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:03.494699 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:03.494988 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:03.494991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:03.494993 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:03.495286 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:03.495442 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.495712 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.495841 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 05:55:03.499505 7349 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37886:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:03.503348 7349 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:03.518376 7868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.512424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51814 (local address 127.2.191.65:42369)
0808 05:55:03.512760 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.512769 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.512795 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:55:03.513018 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.513024 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.513266 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.513420 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:03.513981 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.515064 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.516697 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.517573 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.517701 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.517871 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.518120 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.518218 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":84,"threads_started":1}
I20260808 05:55:03.518368 7867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.512226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:42369 (local address 127.0.0.1:51814)
0808 05:55:03.512611 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.512670 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:03.512833 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:03.513612 (+ 779us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:03.513618 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:03.513643 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:03.513793 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.513801 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.515196 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.515200 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.516546 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.516556 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.517702 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.517705 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.517899 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.517950 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 05:55:03.518083 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 05:55:03.518211 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":49,"thread_start_us":109,"threads_started":1}
I20260808 05:55:03.519008 7869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.513440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34689 (local address 127.0.0.1:57298)
0808 05:55:03.514065 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.514077 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:03.514171 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:03.514730 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:03.514733 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:03.514751 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:03.514864 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.514874 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.516177 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.516182 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.517265 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.517277 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.518537 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.518541 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.518651 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.518677 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 05:55:03.518760 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:55:03.518836 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"mutex_wait_us":24,"thread_start_us":78,"threads_started":1}
I20260808 05:55:03.519093 7872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.513893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57298 (local address 127.2.191.66:34689)
0808 05:55:03.514287 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.514304 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.514322 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:55:03.514390 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.514396 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.514553 (+ 157us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.514748 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:03.515151 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.516044 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.517422 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.518248 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.518351 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.518474 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.518823 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.518920 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":108,"threads_started":1}
I20260808 05:55:03.519879 7871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.513105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:35473 (local address 127.0.0.1:57740)
0808 05:55:03.513682 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.513701 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:03.513798 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:03.514522 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:03.514525 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:03.514543 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:03.514639 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.514645 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.516881 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.516886 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.517872 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.517883 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.518968 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.518971 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.519067 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.519111 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 05:55:03.519444 (+ 333us) client_negotiation.cc:240] Negotiation successful
0808 05:55:03.519528 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"mutex_wait_us":26,"thread_start_us":115,"threads_started":1}
I20260808 05:55:03.520632 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.513293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57740 (local address 127.2.191.67:35473)
0808 05:55:03.514058 (+ 765us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.514084 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.514107 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:55:03.514183 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.514188 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.514378 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.514529 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:03.514772 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.516700 (+ 1928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.518021 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.518835 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.520151 (+ 1316us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.520322 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.520375 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.520474 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":103,"threads_started":1}
I20260808 05:55:03.522146 7487 tablet_service.cc:1467] Processing CreateTablet for tablet 6f8407e82a354977b131db0426879cdc (DEFAULT_TABLE table=test-table [id=4a8a297c8ef94d4c8d129ee54d8c1ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:03.522167 7638 tablet_service.cc:1467] Processing CreateTablet for tablet 6f8407e82a354977b131db0426879cdc (DEFAULT_TABLE table=test-table [id=4a8a297c8ef94d4c8d129ee54d8c1ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:03.523243 7638 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f8407e82a354977b131db0426879cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:03.523244 7487 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f8407e82a354977b131db0426879cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:03.523859 7787 tablet_service.cc:1467] Processing CreateTablet for tablet 6f8407e82a354977b131db0426879cdc (DEFAULT_TABLE table=test-table [id=4a8a297c8ef94d4c8d129ee54d8c1ea0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:03.524902 7787 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6f8407e82a354977b131db0426879cdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:03.529907 7873 tablet_bootstrap.cc:492] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4: Bootstrap starting.
I20260808 05:55:03.531384 7876 tablet_bootstrap.cc:492] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: Bootstrap starting.
I20260808 05:55:03.531850 7877 tablet_bootstrap.cc:492] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: Bootstrap starting.
I20260808 05:55:03.532452 7873 tablet_bootstrap.cc:654] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:03.533397 7873 log.cc:824] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:03.533936 7877 tablet_bootstrap.cc:654] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:03.534296 7876 tablet_bootstrap.cc:654] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:03.535193 7876 log.cc:824] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:03.535597 7877 log.cc:824] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:03.535888 7873 tablet_bootstrap.cc:492] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4: No bootstrap required, opened a new log
I20260808 05:55:03.536118 7873 ts_tablet_manager.cc:1397] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:55:03.537140 7876 tablet_bootstrap.cc:492] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: No bootstrap required, opened a new log
I20260808 05:55:03.537348 7876 ts_tablet_manager.cc:1397] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 05:55:03.539808 7873 raft_consensus.cc:348] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.540072 7873 raft_consensus.cc:374] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:03.540158 7873 raft_consensus.cc:729] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92b9ecdb8ffb42ec932bee1c5d4bbfd4, State: Initialized, Role: FOLLOWER
I20260808 05:55:03.540167 7876 raft_consensus.cc:348] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.540537 7876 raft_consensus.cc:374] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:03.540627 7876 raft_consensus.cc:729] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20bcc47d5df434d8741db3b172ae78c, State: Initialized, Role: FOLLOWER
I20260808 05:55:03.540678 7873 consensus_queue.cc:260] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.541109 7876 consensus_queue.cc:260] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.541857 7873 ts_tablet_manager.cc:1428] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 05:55:03.542292 7561 heartbeater.cc:503] Master 127.2.191.126:33337 was elected leader, sending a full tablet report...
I20260808 05:55:03.542352 7877 tablet_bootstrap.cc:492] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: No bootstrap required, opened a new log
I20260808 05:55:03.542557 7877 ts_tablet_manager.cc:1397] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: Time spent bootstrapping tablet: real 0.011s user 0.000s sys 0.004s
I20260808 05:55:03.543401 7876 ts_tablet_manager.cc:1428] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 05:55:03.544013 7710 heartbeater.cc:503] Master 127.2.191.126:33337 was elected leader, sending a full tablet report...
I20260808 05:55:03.546628 7877 raft_consensus.cc:348] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.546918 7877 raft_consensus.cc:374] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:03.547012 7877 raft_consensus.cc:729] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab8837c258ef4475b9e8a0869bf1f8b1, State: Initialized, Role: FOLLOWER
I20260808 05:55:03.547531 7877 consensus_queue.cc:260] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.548280 7856 heartbeater.cc:503] Master 127.2.191.126:33337 was elected leader, sending a full tablet report...
I20260808 05:55:03.548553 7877 ts_tablet_manager.cc:1428] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: Time spent starting tablet: real 0.006s user 0.004s sys 0.003s
I20260808 05:55:03.576987 7882 raft_consensus.cc:482] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:03.577211 7882 raft_consensus.cc:504] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.578320 7882 leader_election.cc:288] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ab8837c258ef4475b9e8a0869bf1f8b1 (127.2.191.67:35473), c20bcc47d5df434d8741db3b172ae78c (127.2.191.66:34689)
I20260808 05:55:03.584465 7870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.578806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:41081 (local address 127.2.191.67:35473)
0808 05:55:03.579080 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.579085 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.579181 (+ 96us) server_negotiation.cc:407] Connection header received
0808 05:55:03.579421 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.579426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.579518 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.579600 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:03.579960 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.580809 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.582927 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.583648 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.583764 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.583821 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.584226 (+ 405us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.584317 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
I20260808 05:55:03.584455 7872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.579225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:44221 (local address 127.2.191.66:34689)
0808 05:55:03.579369 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.579375 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.579489 (+ 114us) server_negotiation.cc:407] Connection header received
0808 05:55:03.579591 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.579594 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.579641 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.579713 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:03.579960 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.580810 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.582927 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.583621 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.583764 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.583836 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.584238 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.584318 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 05:55:03.584483 7885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.578622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:35473 (local address 127.2.191.65:41081)
0808 05:55:03.579087 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.579103 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:03.579265 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:03.579636 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:03.579638 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:03.579652 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:03.579829 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.579836 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.580935 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.580938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.582759 (+ 1821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.582771 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.583774 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.583778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.584019 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.584075 (+ 56us) client_negotiation.cc:769] Sending connection context
0808 05:55:03.584165 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:55:03.584283 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":382,"thread_start_us":133,"threads_started":1}
I20260808 05:55:03.584483 7886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.579092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34689 (local address 127.2.191.65:44221)
0808 05:55:03.579395 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.579415 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:03.579488 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:03.579735 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:03.579738 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:03.579752 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:03.579841 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.579846 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.580935 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.580938 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.582758 (+ 1820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:03.582771 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.583774 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.583778 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:03.584014 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.584103 (+ 89us) client_negotiation.cc:769] Sending connection context
0808 05:55:03.584204 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 05:55:03.584272 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":239,"mutex_wait_us":248,"thread_start_us":123,"threads_started":1}
I20260808 05:55:03.585340 7660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f8407e82a354977b131db0426879cdc" candidate_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20bcc47d5df434d8741db3b172ae78c" is_pre_election: true
I20260808 05:55:03.585335 7808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f8407e82a354977b131db0426879cdc" candidate_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" is_pre_election: true
I20260808 05:55:03.585669 7660 raft_consensus.cc:2454] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92b9ecdb8ffb42ec932bee1c5d4bbfd4 in term 0.
I20260808 05:55:03.585677 7808 raft_consensus.cc:2454] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92b9ecdb8ffb42ec932bee1c5d4bbfd4 in term 0.
I20260808 05:55:03.586174 7434 leader_election.cc:302] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92b9ecdb8ffb42ec932bee1c5d4bbfd4, c20bcc47d5df434d8741db3b172ae78c; no voters:
I20260808 05:55:03.586539 7882 raft_consensus.cc:2781] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:03.586637 7882 raft_consensus.cc:482] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:03.586669 7882 raft_consensus.cc:3037] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:03.587890 7882 raft_consensus.cc:504] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.588261 7882 leader_election.cc:288] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [CANDIDATE]: Term 1 election: Requested vote from peers ab8837c258ef4475b9e8a0869bf1f8b1 (127.2.191.67:35473), c20bcc47d5df434d8741db3b172ae78c (127.2.191.66:34689)
I20260808 05:55:03.588861 7808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f8407e82a354977b131db0426879cdc" candidate_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1"
I20260808 05:55:03.588984 7660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f8407e82a354977b131db0426879cdc" candidate_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c20bcc47d5df434d8741db3b172ae78c"
I20260808 05:55:03.589165 7660 raft_consensus.cc:3037] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:03.589134 7808 raft_consensus.cc:3037] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:03.590540 7660 raft_consensus.cc:2454] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92b9ecdb8ffb42ec932bee1c5d4bbfd4 in term 1.
I20260808 05:55:03.590644 7808 raft_consensus.cc:2454] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92b9ecdb8ffb42ec932bee1c5d4bbfd4 in term 1.
I20260808 05:55:03.590886 7434 leader_election.cc:302] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92b9ecdb8ffb42ec932bee1c5d4bbfd4, c20bcc47d5df434d8741db3b172ae78c; no voters:
I20260808 05:55:03.591158 7882 raft_consensus.cc:2781] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:03.591440 7882 raft_consensus.cc:686] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [term 1 LEADER]: Becoming Leader. State: Replica: 92b9ecdb8ffb42ec932bee1c5d4bbfd4, State: Running, Role: LEADER
I20260808 05:55:03.591838 7882 consensus_queue.cc:237] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } }
I20260808 05:55:03.595530 7348 catalog_manager.cc:5495] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 92b9ecdb8ffb42ec932bee1c5d4bbfd4 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92b9ecdb8ffb42ec932bee1c5d4bbfd4" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 } health_report { overall_health: UNKNOWN } } }
I20260808 05:55:03.618042 7868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.614477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51822 (local address 127.2.191.65:42369)
0808 05:55:03.614624 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.614628 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.614642 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:03.614718 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.614720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.614774 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.614866 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:03.615151 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.615672 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.616507 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:03.616723 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:03.616878 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:03.617197 (+ 319us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:03.617627 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:03.617722 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.617795 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.617847 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 05:55:03.624420 7660 raft_consensus.cc:1261] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 1 FOLLOWER]: Refusing update from remote peer 92b9ecdb8ffb42ec932bee1c5d4bbfd4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:03.624420 7808 raft_consensus.cc:1261] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 1 FOLLOWER]: Refusing update from remote peer 92b9ecdb8ffb42ec932bee1c5d4bbfd4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:03.625267 7882 consensus_queue.cc:1035] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c20bcc47d5df434d8741db3b172ae78c" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:03.625494 7887 consensus_queue.cc:1035] T 6f8407e82a354977b131db0426879cdc P 92b9ecdb8ffb42ec932bee1c5d4bbfd4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ab8837c258ef4475b9e8a0869bf1f8b1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:03.642967 7349 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:03.643189 7349 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37886:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:03.646011 7349 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 44836a2cf7fa41b089712277a2e91c4a: Sending DeleteTablet for 3 replicas of tablet 6f8407e82a354977b131db0426879cdc
I20260808 05:55:03.646828 7487 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f8407e82a354977b131db0426879cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:03 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:51814
I20260808 05:55:03.647017 7787 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f8407e82a354977b131db0426879cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:03 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:57740
I20260808 05:55:03.647156 7638 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f8407e82a354977b131db0426879cdc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:03 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:57298
I20260808 05:55:03.647668 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 7418
I20260808 05:55:03.650513 7904 tablet_replica.cc:330] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: stopping tablet replica
I20260808 05:55:03.650874 7904 raft_consensus.cc:2229] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:03.651212 7904 raft_consensus.cc:2258] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:03.651647 7902 tablet_replica.cc:330] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: stopping tablet replica
I20260808 05:55:03.651948 7902 raft_consensus.cc:2229] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:03.652238 7902 raft_consensus.cc:2258] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:03.653635 7904 ts_tablet_manager.cc:1905] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 05:55:03.656347 7331 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:42369 (error 108)
I20260808 05:55:03.656478 7904 ts_tablet_manager.cc:1918] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:03.656591 7904 log.cc:1196] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/6f8407e82a354977b131db0426879cdc
I20260808 05:55:03.656888 7902 ts_tablet_manager.cc:1905] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:03.657019 7904 ts_tablet_manager.cc:1939] T 6f8407e82a354977b131db0426879cdc P c20bcc47d5df434d8741db3b172ae78c: Deleting consensus metadata
I20260808 05:55:03.657313 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 7566
I20260808 05:55:03.657526 7871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.657233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:42369 (local address 127.0.0.1:51830)
0808 05:55:03.657367 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.657442 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:42369: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 05:55:03.664935 7331 catalog_manager.cc:4584] TS 92b9ecdb8ffb42ec932bee1c5d4bbfd4 (127.2.191.65:42369): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6f8407e82a354977b131db0426879cdc: Network error: Client connection negotiation failed: client connection to 127.2.191.65:42369: connect: Connection refused (error 111)
I20260808 05:55:03.667049 7902 ts_tablet_manager.cc:1918] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:03.667150 7902 log.cc:1196] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/6f8407e82a354977b131db0426879cdc
I20260808 05:55:03.667474 7902 ts_tablet_manager.cc:1939] T 6f8407e82a354977b131db0426879cdc P ab8837c258ef4475b9e8a0869bf1f8b1: Deleting consensus metadata
I20260808 05:55:03.668781 7331 catalog_manager.cc:4841] TS ab8837c258ef4475b9e8a0869bf1f8b1 (127.2.191.67:35473): tablet 6f8407e82a354977b131db0426879cdc (table test-table [id=4a8a297c8ef94d4c8d129ee54d8c1ea0]) successfully deleted
I20260808 05:55:03.669682 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 7715
I20260808 05:55:03.672937 7871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.669947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34689 (local address 127.0.0.1:57302)
0808 05:55:03.672677 (+ 2730us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:03.672813 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.66:34689: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2598}
I20260808 05:55:03.678807 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 7314
2026-08-08T05:55:03Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2442 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T05:55:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:03Z Disabled control of system clock
I20260808 05:55:03.713482 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34681
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:44773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:34681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:55:03.840600 7910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:03.840951 7910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:03.840996 7910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:03.845063 7910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:03.845136 7910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:03.845151 7910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:03.845168 7910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:03.845183 7910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:03.850132 7910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:34681
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:03.851217 7910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:03.852592 7910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:03.861896 7919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:03.861884 7916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:03.861860 7917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:03.862083 7910 server_base.cc:1034] running on GCE node
I20260808 05:55:03.862835 7910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:03.863983 7910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:03.865212 7910 hybrid_clock.cc:648] HybridClock initialized: now 1786168503865192 us; error 38 us; skew 500 ppm
I20260808 05:55:03.867112 7910 webserver.cc:460] Webserver started at http://127.2.191.126:46023/ using document root <none> and password file <none>
I20260808 05:55:03.867729 7910 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:03.867826 7910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:03.868099 7910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:03.870368 7910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "ab8f99f897ad45dd8deb03f7015f6f29"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "8d0634f9d12cfa652c00cb298e0fd99a"
server_key_iv: "8a83d4e9c424ca280a7ecfa1a0863ad9"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.870980 7910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "ab8f99f897ad45dd8deb03f7015f6f29"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "8d0634f9d12cfa652c00cb298e0fd99a"
server_key_iv: "8a83d4e9c424ca280a7ecfa1a0863ad9"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.875011 7910 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:03.877590 7925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:03.878823 7910 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 05:55:03.878975 7910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "ab8f99f897ad45dd8deb03f7015f6f29"
format_stamp: "Formatted at 2026-08-08 05:55:03 on dist-test-slave-qg60"
server_key: "8d0634f9d12cfa652c00cb298e0fd99a"
server_key_iv: "8a83d4e9c424ca280a7ecfa1a0863ad9"
server_key_version: "encryptionkey@0"
I20260808 05:55:03.879117 7910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:03.883889 7910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:03.884508 7910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:03.884721 7910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:03.891585 7910 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:34681
I20260808 05:55:03.891606 7980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:34681 every 8 connection(s)
I20260808 05:55:03.892549 7910 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:03.895823 7981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:03.899893 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 7910
I20260808 05:55:03.900033 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:03.900349 2813 external_mini_cluster.cc:1428] Setting key a72c1ed3fb06d04f062ae103a425f3b0
I20260808 05:55:03.902264 7981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29: Bootstrap starting.
I20260808 05:55:03.904543 7981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:03.905462 7981 log.cc:824] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:03.907037 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:03.901928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47734 (local address 127.2.191.126:34681)
0808 05:55:03.902713 (+ 785us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:03.902731 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:03.902773 (+ 42us) server_negotiation.cc:407] Connection header received
0808 05:55:03.903653 (+ 880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:03.903674 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:03.904090 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:03.904471 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:03.905359 (+ 888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:03.905364 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:03.905384 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:03.905395 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:03.905451 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:03.905469 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:03.905604 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:03.905752 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 05:55:03.906046 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":153,"threads_started":1}
I20260808 05:55:03.907939 7981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29: No bootstrap required, opened a new log
I20260808 05:55:03.911989 7981 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8f99f897ad45dd8deb03f7015f6f29" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34681 } }
I20260808 05:55:03.912227 7981 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:03.912266 7981 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab8f99f897ad45dd8deb03f7015f6f29, State: Initialized, Role: FOLLOWER
I20260808 05:55:03.912663 7981 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8f99f897ad45dd8deb03f7015f6f29" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34681 } }
I20260808 05:55:03.912860 7981 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:03.912916 7981 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:03.912997 7981 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:03.913982 7981 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8f99f897ad45dd8deb03f7015f6f29" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34681 } }
I20260808 05:55:03.914304 7981 leader_election.cc:302] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab8f99f897ad45dd8deb03f7015f6f29; no voters:
I20260808 05:55:03.914606 7981 leader_election.cc:288] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:03.914767 7986 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:03.915005 7986 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [term 1 LEADER]: Becoming Leader. State: Replica: ab8f99f897ad45dd8deb03f7015f6f29, State: Running, Role: LEADER
I20260808 05:55:03.915347 7986 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8f99f897ad45dd8deb03f7015f6f29" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34681 } }
I20260808 05:55:03.916010 7981 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:03.917138 7988 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab8f99f897ad45dd8deb03f7015f6f29. Latest consensus state: current_term: 1 leader_uuid: "ab8f99f897ad45dd8deb03f7015f6f29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8f99f897ad45dd8deb03f7015f6f29" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34681 } } }
I20260808 05:55:03.917193 7987 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab8f99f897ad45dd8deb03f7015f6f29" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8f99f897ad45dd8deb03f7015f6f29" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34681 } } }
I20260808 05:55:03.917335 7987 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:03.917279 7988 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:03.917785 7995 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:03.920614 7995 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:03.925982 7995 catalog_manager.cc:1347] Generated new cluster ID: 5f3642364ca0415d9a6e04c99eefb4c4
I20260808 05:55:03.926069 7995 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:03.935632 7995 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:03.935998 7995 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:03.943826 7995 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29: Generated new TSK 0
I20260808 05:55:03.944520 7995 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:55:03.953992 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34681
--builtin_ntp_servers=127.2.191.84:44773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:55:04.072379 8006 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:04.072688 8006 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:04.072783 8006 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:04.076807 8006 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:04.076886 8006 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:04.076972 8006 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:04.082017 8006 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8006
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:04.083428 8006 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:04.084929 8006 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:04.094831 8012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:04.094797 8011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:04.094856 8014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:04.095124 8006 server_base.cc:1034] running on GCE node
I20260808 05:55:04.095624 8006 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:04.096323 8006 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:04.097493 8006 hybrid_clock.cc:648] HybridClock initialized: now 1786168504097475 us; error 30 us; skew 500 ppm
I20260808 05:55:04.099398 8006 webserver.cc:460] Webserver started at http://127.2.191.65:33565/ using document root <none> and password file <none>
I20260808 05:55:04.099980 8006 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:04.100055 8006 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:04.100296 8006 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:04.102449 8006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "7d099d438d4535be893d473161764f95"
server_key_iv: "d80580e7d184e7f71da9c676100099c4"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.103014 8006 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "7d099d438d4535be893d473161764f95"
server_key_iv: "d80580e7d184e7f71da9c676100099c4"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.106814 8006 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 05:55:04.109341 8021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.110620 8006 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:04.110750 8006 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "7d099d438d4535be893d473161764f95"
server_key_iv: "d80580e7d184e7f71da9c676100099c4"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.110860 8006 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:04.115674 8006 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:04.116348 8006 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:04.116534 8006 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:04.117236 8006 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:04.118258 8006 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:04.118332 8006 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.118396 8006 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:04.118451 8006 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.127223 8006 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:45785
I20260808 05:55:04.127254 8147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:45785 every 8 connection(s)
I20260808 05:55:04.128180 8006 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:04.131471 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 8006
I20260808 05:55:04.131618 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:04.131897 2813 external_mini_cluster.cc:1428] Setting key 5723b769a76f1f94a3176d1b4b5c65bf
I20260808 05:55:04.133898 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34681
--builtin_ntp_servers=127.2.191.84:44773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 05:55:04.135720 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.130132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:51957 (local address 127.2.191.126:34681)
0808 05:55:04.130322 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.130327 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.132053 (+ 1726us) server_negotiation.cc:407] Connection header received
0808 05:55:04.133623 (+ 1570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.133627 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.133671 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.133779 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.135167 (+ 1388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.135171 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.135175 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.135194 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.135216 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.135225 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.135329 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.135527 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.135579 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 05:55:04.136646 8151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.130573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34681 (local address 127.2.191.65:51957)
0808 05:55:04.131802 (+ 1229us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.131845 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:04.133396 (+ 1551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:04.133955 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:04.133962 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:04.134086 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:04.134798 (+ 712us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:04.134800 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:04.134843 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:04.134915 (+ 72us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:04.135314 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:04.135324 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:04.135330 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:55:04.135529 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 05:55:04.135794 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":752,"thread_start_us":118,"threads_started":1}
I20260808 05:55:04.138060 8148 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34681
I20260808 05:55:04.138476 8148 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:04.139017 8148 heartbeater.cc:511] Master 127.2.191.126:34681 requested a full tablet report, sending...
I20260808 05:55:04.140872 7943 ts_manager.cc:194] Registered new tserver with Master: eb6c3f13dbb343b5bea01d2a5fac1dc9 (127.2.191.65:45785)
W20260808 05:55:04.252978 8152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:04.253297 8152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:04.253369 8152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:04.257426 8152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:04.257511 8152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:04.257608 8152 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:04.262527 8152 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:04.263698 8152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:04.265195 8152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:04.275144 8157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:04.275189 8158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:04.275283 8152 server_base.cc:1034] running on GCE node
W20260808 05:55:04.275151 8160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:04.275897 8152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:04.276542 8152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:04.277724 8152 hybrid_clock.cc:648] HybridClock initialized: now 1786168504277697 us; error 51 us; skew 500 ppm
I20260808 05:55:04.279726 8152 webserver.cc:460] Webserver started at http://127.2.191.66:46055/ using document root <none> and password file <none>
I20260808 05:55:04.280324 8152 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:04.280391 8152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:04.280616 8152 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:04.282819 8152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "a4394cb2ad4f4d3fafa013cae78a422f"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "4351f41659440c979878ad07180339eb"
server_key_iv: "912248315c5f3674c082a1f0adea0b43"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.283427 8152 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "a4394cb2ad4f4d3fafa013cae78a422f"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "4351f41659440c979878ad07180339eb"
server_key_iv: "912248315c5f3674c082a1f0adea0b43"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.287350 8152 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:55:04.289830 8168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.291039 8152 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:55:04.291180 8152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "a4394cb2ad4f4d3fafa013cae78a422f"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "4351f41659440c979878ad07180339eb"
server_key_iv: "912248315c5f3674c082a1f0adea0b43"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.291296 8152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:04.295933 8152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:04.296535 8152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:04.296772 8152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:04.297320 8152 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:04.298234 8152 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:04.298306 8152 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.298375 8152 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:04.298429 8152 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.307643 8152 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:35203
I20260808 05:55:04.307662 8296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:35203 every 8 connection(s)
I20260808 05:55:04.308547 8152 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:04.311975 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 8152
I20260808 05:55:04.312122 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:04.312429 2813 external_mini_cluster.cc:1428] Setting key 697bde3c736e26bdb252872d322913c1
I20260808 05:55:04.314632 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34681
--builtin_ntp_servers=127.2.191.84:44773
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 05:55:04.315336 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.310426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:36705 (local address 127.2.191.126:34681)
0808 05:55:04.310582 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.310586 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.311654 (+ 1068us) server_negotiation.cc:407] Connection header received
0808 05:55:04.313253 (+ 1599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.313257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.313302 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.313394 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.314677 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.314681 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.314687 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.314704 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.314730 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.314743 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.314848 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.315089 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.315140 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:55:04.316140 8300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.310775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34681 (local address 127.2.191.66:36705)
0808 05:55:04.311463 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.311507 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:04.312998 (+ 1491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:04.313563 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:04.313571 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:04.313666 (+ 95us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:04.314398 (+ 732us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:04.314400 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:04.314442 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:04.314510 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:04.314851 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:04.314860 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:04.314866 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:55:04.315101 (+ 235us) client_negotiation.cc:240] Negotiation successful
0808 05:55:04.315327 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":107,"threads_started":1}
I20260808 05:55:04.317391 8298 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34681
I20260808 05:55:04.317637 8298 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:04.318009 8298 heartbeater.cc:511] Master 127.2.191.126:34681 requested a full tablet report, sending...
I20260808 05:55:04.319069 7943 ts_manager.cc:194] Registered new tserver with Master: a4394cb2ad4f4d3fafa013cae78a422f (127.2.191.66:35203)
W20260808 05:55:04.433828 8301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:04.434139 8301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:04.434244 8301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:04.438393 8301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:04.438488 8301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:04.438580 8301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:04.443658 8301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44773
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34681
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8301
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:04.444999 8301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:04.446583 8301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:55:04.456890 8301 server_base.cc:1034] running on GCE node
W20260808 05:55:04.456905 8307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:04.457072 8308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:04.456905 8310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:04.457561 8301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:04.458223 8301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:04.459416 8301 hybrid_clock.cc:648] HybridClock initialized: now 1786168504459384 us; error 57 us; skew 500 ppm
I20260808 05:55:04.461602 8301 webserver.cc:460] Webserver started at http://127.2.191.67:36781/ using document root <none> and password file <none>
I20260808 05:55:04.462229 8301 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:04.462332 8301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:04.462587 8301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:04.464870 8301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "85428bb83727477d8e2662ad0c2fe885"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "4e3b604e1c78e81ef46499e5f3faa410"
server_key_iv: "37808e638a3c4228381f01d003b2daba"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.465503 8301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "85428bb83727477d8e2662ad0c2fe885"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "4e3b604e1c78e81ef46499e5f3faa410"
server_key_iv: "37808e638a3c4228381f01d003b2daba"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.469436 8301 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:55:04.472177 8316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.473465 8301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:04.473613 8301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "85428bb83727477d8e2662ad0c2fe885"
format_stamp: "Formatted at 2026-08-08 05:55:04 on dist-test-slave-qg60"
server_key: "4e3b604e1c78e81ef46499e5f3faa410"
server_key_iv: "37808e638a3c4228381f01d003b2daba"
server_key_version: "encryptionkey@0"
I20260808 05:55:04.473737 8301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:04.478338 8301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:04.478947 8301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:04.479147 8301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:04.479701 8301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:04.480638 8301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:04.480711 8301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.480801 8301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:04.480855 8301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:04.490236 8301 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:46561
I20260808 05:55:04.490259 8437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:46561 every 8 connection(s)
I20260808 05:55:04.491205 8301 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:04.494050 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 8301
I20260808 05:55:04.494203 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:04.494473 2813 external_mini_cluster.cc:1428] Setting key 64114a643652c234de4eb3cfd9d08e3a
I20260808 05:55:04.498211 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.493262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:50123 (local address 127.2.191.126:34681)
0808 05:55:04.493440 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.493446 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.494612 (+ 1166us) server_negotiation.cc:407] Connection header received
0808 05:55:04.496397 (+ 1785us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.496399 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.496439 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.496515 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.497797 (+ 1282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.497800 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.497802 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.497815 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.497838 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.497846 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.497932 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.498057 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.498100 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 05:55:04.499172 8440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.493712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34681 (local address 127.2.191.67:50123)
0808 05:55:04.494451 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.494506 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:04.496167 (+ 1661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:04.496694 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:04.496703 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:04.496880 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:04.497522 (+ 642us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:04.497524 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:04.497566 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:04.497639 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:04.497931 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:04.497938 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:04.497942 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:55:04.498074 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 05:55:04.498292 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":143,"threads_started":1}
I20260808 05:55:04.500560 8438 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34681
I20260808 05:55:04.500845 8438 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:04.501287 8438 heartbeater.cc:511] Master 127.2.191.126:34681 requested a full tablet report, sending...
I20260808 05:55:04.502707 7943 ts_manager.cc:194] Registered new tserver with Master: 85428bb83727477d8e2662ad0c2fe885 (127.2.191.67:46561)
I20260808 05:55:04.508781 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:55:04.512280 7984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.510693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47740 (local address 127.2.191.126:34681)
0808 05:55:04.510828 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.510831 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.511051 (+ 220us) server_negotiation.cc:407] Connection header received
0808 05:55:04.511167 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.511169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.511201 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.511270 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.511976 (+ 706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.511979 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.511981 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.511989 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.512003 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.512009 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.512073 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.512146 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.512179 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:55:04.515316 7943 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47740:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:04.518790 7943 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:04.531543 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.527912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55834 (local address 127.2.191.65:45785)
0808 05:55:04.529464 (+ 1552us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.529474 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.529493 (+ 19us) server_negotiation.cc:407] Connection header received
0808 05:55:04.529537 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.529541 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.529674 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.529830 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.530864 (+ 1034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.530873 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.530885 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.530897 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.530944 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.530983 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.531151 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.531297 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.531370 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1443,"thread_start_us":113,"threads_started":1}
I20260808 05:55:04.531535 8449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.527758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:45785 (local address 127.0.0.1:55834)
0808 05:55:04.528416 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.528468 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:04.528578 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:04.529831 (+ 1253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:04.529837 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:04.529912 (+ 75us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:04.530658 (+ 746us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:04.530660 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:04.530677 (+ 17us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:04.530731 (+ 54us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:04.531126 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:04.531136 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:04.531142 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:55:04.531282 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 05:55:04.531354 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":107,"threads_started":1}
I20260808 05:55:04.531972 8452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.527927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:35203 (local address 127.0.0.1:53930)
0808 05:55:04.528811 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.528826 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:04.528894 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:04.530685 (+ 1791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:04.530688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:04.530702 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:04.531197 (+ 495us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:04.531200 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:04.531213 (+ 13us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:04.531250 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:04.531696 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:04.531703 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:04.531711 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 05:55:04.531781 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 05:55:04.531826 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":107,"threads_started":1}
I20260808 05:55:04.532399 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.528192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:46561 (local address 127.0.0.1:38328)
0808 05:55:04.529114 (+ 922us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.529127 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:04.529204 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:04.530891 (+ 1687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:04.530895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:04.530909 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:04.531740 (+ 831us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:04.531742 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:04.531752 (+ 10us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:04.531776 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:04.532176 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:04.532179 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:04.532182 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:55:04.532252 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 05:55:04.532286 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":846,"thread_start_us":110,"threads_started":1}
I20260808 05:55:04.532653 8453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.528628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53930 (local address 127.2.191.66:35203)
0808 05:55:04.529422 (+ 794us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.529434 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.529467 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:55:04.529519 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.529524 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.529662 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.529818 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.531441 (+ 1623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.531453 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.531467 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.531481 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.531531 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.531568 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.532309 (+ 741us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.532367 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.532447 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":160,"threads_started":1}
I20260808 05:55:04.532823 8454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.528897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38328 (local address 127.2.191.67:46561)
0808 05:55:04.529281 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.529296 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.529325 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:55:04.529386 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.529393 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.529649 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.529819 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.531911 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.531920 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.531930 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.531942 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.531987 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.532027 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.532132 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.532546 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.532630 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":157,"threads_started":1}
I20260808 05:55:04.535034 8078 tablet_service.cc:1467] Processing CreateTablet for tablet d882b842afd8499aa386eb24aa7c8d68 (DEFAULT_TABLE table=test-table [id=a4a52c3f4f2c4a6f886d0d57cc30b27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:04.535167 8366 tablet_service.cc:1467] Processing CreateTablet for tablet d882b842afd8499aa386eb24aa7c8d68 (DEFAULT_TABLE table=test-table [id=a4a52c3f4f2c4a6f886d0d57cc30b27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:04.535377 8223 tablet_service.cc:1467] Processing CreateTablet for tablet d882b842afd8499aa386eb24aa7c8d68 (DEFAULT_TABLE table=test-table [id=a4a52c3f4f2c4a6f886d0d57cc30b27c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:04.536223 8078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d882b842afd8499aa386eb24aa7c8d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:04.536223 8223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d882b842afd8499aa386eb24aa7c8d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:04.536252 8366 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d882b842afd8499aa386eb24aa7c8d68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:04.542814 8455 tablet_bootstrap.cc:492] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Bootstrap starting.
I20260808 05:55:04.543854 8458 tablet_bootstrap.cc:492] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9: Bootstrap starting.
I20260808 05:55:04.544276 8457 tablet_bootstrap.cc:492] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: Bootstrap starting.
I20260808 05:55:04.546213 8457 tablet_bootstrap.cc:654] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:04.546214 8455 tablet_bootstrap.cc:654] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:04.547004 8455 log.cc:824] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:04.547055 8457 log.cc:824] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:04.548504 8458 tablet_bootstrap.cc:654] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:04.549214 8457 tablet_bootstrap.cc:492] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: No bootstrap required, opened a new log
I20260808 05:55:04.549263 8455 tablet_bootstrap.cc:492] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: No bootstrap required, opened a new log
I20260808 05:55:04.549448 8457 ts_tablet_manager.cc:1397] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260808 05:55:04.549449 8455 ts_tablet_manager.cc:1397] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 05:55:04.549449 8458 log.cc:824] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:04.551728 8458 tablet_bootstrap.cc:492] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9: No bootstrap required, opened a new log
I20260808 05:55:04.551957 8458 ts_tablet_manager.cc:1397] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.003s
I20260808 05:55:04.553330 8455 raft_consensus.cc:348] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.553586 8455 raft_consensus.cc:374] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:04.553663 8455 raft_consensus.cc:729] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 85428bb83727477d8e2662ad0c2fe885, State: Initialized, Role: FOLLOWER
I20260808 05:55:04.554172 8455 consensus_queue.cc:260] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.554862 8438 heartbeater.cc:503] Master 127.2.191.126:34681 was elected leader, sending a full tablet report...
I20260808 05:55:04.554834 8457 raft_consensus.cc:348] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.555119 8457 raft_consensus.cc:374] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:04.555182 8457 raft_consensus.cc:729] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4394cb2ad4f4d3fafa013cae78a422f, State: Initialized, Role: FOLLOWER
I20260808 05:55:04.555243 8455 ts_tablet_manager.cc:1428] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:55:04.555733 8457 consensus_queue.cc:260] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.556461 8298 heartbeater.cc:503] Master 127.2.191.126:34681 was elected leader, sending a full tablet report...
I20260808 05:55:04.557284 8458 raft_consensus.cc:348] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.557634 8458 raft_consensus.cc:374] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:04.557741 8458 raft_consensus.cc:729] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb6c3f13dbb343b5bea01d2a5fac1dc9, State: Initialized, Role: FOLLOWER
I20260808 05:55:04.557909 8457 ts_tablet_manager.cc:1428] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20260808 05:55:04.558292 8458 consensus_queue.cc:260] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.559244 8148 heartbeater.cc:503] Master 127.2.191.126:34681 was elected leader, sending a full tablet report...
I20260808 05:55:04.559386 8458 ts_tablet_manager.cc:1428] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9: Time spent starting tablet: real 0.007s user 0.008s sys 0.001s
W20260808 05:55:04.559697 8299 tablet.cc:2369] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:55:04.629530 8150 tablet.cc:2369] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:55:04.742290 8439 tablet.cc:2369] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:55:04.775067 8462 raft_consensus.cc:482] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:04.775295 8462 raft_consensus.cc:504] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.776556 8462 leader_election.cc:288] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb6c3f13dbb343b5bea01d2a5fac1dc9 (127.2.191.65:45785), a4394cb2ad4f4d3fafa013cae78a422f (127.2.191.66:35203)
I20260808 05:55:04.778697 8440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.776828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:45785 (local address 127.2.191.67:42941)
0808 05:55:04.776964 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.776983 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:04.777092 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:04.777482 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:04.777485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:04.777503 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:04.778012 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:04.778013 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:04.778022 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:04.778068 (+ 46us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:04.778377 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:04.778379 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:04.778384 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:55:04.778488 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 05:55:04.778527 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:55:04.778714 8450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.777034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:42941 (local address 127.2.191.65:45785)
0808 05:55:04.777222 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.777232 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.777247 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:55:04.777290 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.777292 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.777324 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.777436 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.778227 (+ 791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.778230 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.778232 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.778243 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.778287 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.778299 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.778394 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.778534 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.778584 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260808 05:55:04.778770 8465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.776898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:35203 (local address 127.2.191.67:55759)
0808 05:55:04.777354 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.777365 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:04.777470 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:04.777761 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:04.777763 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:04.777775 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:04.778202 (+ 427us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:04.778204 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:04.778211 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:04.778228 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:04.778507 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:04.778512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:04.778515 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:55:04.778603 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 05:55:04.778634 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":146,"threads_started":1}
I20260808 05:55:04.778793 8453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.777100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:55759 (local address 127.2.191.66:35203)
0808 05:55:04.777241 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.777245 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.777447 (+ 202us) server_negotiation.cc:407] Connection header received
0808 05:55:04.777582 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.777586 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.777627 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.777733 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.778356 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.778362 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.778366 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.778379 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.778401 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.778414 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.778493 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.778619 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.778659 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:55:04.779479 8247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d882b842afd8499aa386eb24aa7c8d68" candidate_uuid: "85428bb83727477d8e2662ad0c2fe885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" is_pre_election: true
I20260808 05:55:04.779539 8100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d882b842afd8499aa386eb24aa7c8d68" candidate_uuid: "85428bb83727477d8e2662ad0c2fe885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" is_pre_election: true
I20260808 05:55:04.779812 8247 raft_consensus.cc:2454] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85428bb83727477d8e2662ad0c2fe885 in term 0.
I20260808 05:55:04.779835 8100 raft_consensus.cc:2454] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 85428bb83727477d8e2662ad0c2fe885 in term 0.
I20260808 05:55:04.780323 8317 leader_election.cc:302] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85428bb83727477d8e2662ad0c2fe885, a4394cb2ad4f4d3fafa013cae78a422f; no voters:
I20260808 05:55:04.780599 8462 raft_consensus.cc:2781] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:04.780689 8462 raft_consensus.cc:482] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:04.780757 8462 raft_consensus.cc:3037] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:04.781800 8462 raft_consensus.cc:504] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.782157 8462 leader_election.cc:288] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [CANDIDATE]: Term 1 election: Requested vote from peers eb6c3f13dbb343b5bea01d2a5fac1dc9 (127.2.191.65:45785), a4394cb2ad4f4d3fafa013cae78a422f (127.2.191.66:35203)
I20260808 05:55:04.782516 8100 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d882b842afd8499aa386eb24aa7c8d68" candidate_uuid: "85428bb83727477d8e2662ad0c2fe885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9"
I20260808 05:55:04.782570 8247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d882b842afd8499aa386eb24aa7c8d68" candidate_uuid: "85428bb83727477d8e2662ad0c2fe885" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4394cb2ad4f4d3fafa013cae78a422f"
I20260808 05:55:04.782660 8100 raft_consensus.cc:3037] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:04.782727 8247 raft_consensus.cc:3037] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:04.783828 8247 raft_consensus.cc:2454] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85428bb83727477d8e2662ad0c2fe885 in term 1.
I20260808 05:55:04.783960 8100 raft_consensus.cc:2454] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 85428bb83727477d8e2662ad0c2fe885 in term 1.
I20260808 05:55:04.784159 8317 leader_election.cc:302] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 85428bb83727477d8e2662ad0c2fe885, a4394cb2ad4f4d3fafa013cae78a422f; no voters:
I20260808 05:55:04.784341 8462 raft_consensus.cc:2781] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:04.784616 8462 raft_consensus.cc:686] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 1 LEADER]: Becoming Leader. State: Replica: 85428bb83727477d8e2662ad0c2fe885, State: Running, Role: LEADER
I20260808 05:55:04.785009 8462 consensus_queue.cc:237] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } }
I20260808 05:55:04.788220 7941 catalog_manager.cc:5495] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 reported cstate change: term changed from 0 to 1, leader changed from <none> to 85428bb83727477d8e2662ad0c2fe885 (127.2.191.67). New cstate: current_term: 1 leader_uuid: "85428bb83727477d8e2662ad0c2fe885" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "85428bb83727477d8e2662ad0c2fe885" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46561 } health_report { overall_health: HEALTHY } } }
I20260808 05:55:04.826895 8454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.825170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38330 (local address 127.2.191.67:46561)
0808 05:55:04.825320 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:04.825327 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:04.825342 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:55:04.825432 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:04.825434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:04.825510 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:04.825610 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:04.826436 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:04.826439 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:04.826442 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:04.826454 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:04.826485 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:04.826494 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:04.826593 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:04.826665 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 05:55:04.826709 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:55:04.833001 8247 raft_consensus.cc:1261] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 1 FOLLOWER]: Refusing update from remote peer 85428bb83727477d8e2662ad0c2fe885: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:04.833009 8100 raft_consensus.cc:1261] T d882b842afd8499aa386eb24aa7c8d68 P eb6c3f13dbb343b5bea01d2a5fac1dc9 [term 1 FOLLOWER]: Refusing update from remote peer 85428bb83727477d8e2662ad0c2fe885: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:04.833732 8462 consensus_queue.cc:1035] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb6c3f13dbb343b5bea01d2a5fac1dc9" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:04.833951 8466 consensus_queue.cc:1035] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4394cb2ad4f4d3fafa013cae78a422f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 35203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:04.842046 8471 mvcc.cc:205] Tried to move back new op lower bound from 7316146195788218368 to 7316146195601780736. Current Snapshot: MvccSnapshot[applied={T|T < 7316146195788218368}]
I20260808 05:55:04.842404 8473 mvcc.cc:205] Tried to move back new op lower bound from 7316146195788218368 to 7316146195601780736. Current Snapshot: MvccSnapshot[applied={T|T < 7316146195788218368}]
I20260808 05:55:04.850850 7943 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:04.851051 7943 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47740:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:04.853740 7943 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ab8f99f897ad45dd8deb03f7015f6f29: Sending DeleteTablet for 3 replicas of tablet d882b842afd8499aa386eb24aa7c8d68
I20260808 05:55:04.854660 8078 tablet_service.cc:1514] Processing DeleteTablet for tablet d882b842afd8499aa386eb24aa7c8d68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:04 UTC) from {username='slave'} at 127.0.0.1:55834
I20260808 05:55:04.854724 8223 tablet_service.cc:1514] Processing DeleteTablet for tablet d882b842afd8499aa386eb24aa7c8d68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:04 UTC) from {username='slave'} at 127.0.0.1:53930
I20260808 05:55:04.854816 8366 tablet_service.cc:1514] Processing DeleteTablet for tablet d882b842afd8499aa386eb24aa7c8d68 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:04 UTC) from {username='slave'} at 127.0.0.1:38328
I20260808 05:55:04.855441 8481 tablet_replica.cc:330] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: stopping tablet replica
I20260808 05:55:04.855795 8481 raft_consensus.cc:2229] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:55:04.856053 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 8006
I20260808 05:55:04.857049 8481 raft_consensus.cc:2258] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:04.857924 8482 tablet_replica.cc:330] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: stopping tablet replica
I20260808 05:55:04.858367 8482 raft_consensus.cc:2229] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:04.858807 8482 raft_consensus.cc:2258] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:04.859470 8481 ts_tablet_manager.cc:1905] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:04.862393 8481 ts_tablet_manager.cc:1918] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:04.862509 8481 log.cc:1196] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/d882b842afd8499aa386eb24aa7c8d68
I20260808 05:55:04.862877 8481 ts_tablet_manager.cc:1939] T d882b842afd8499aa386eb24aa7c8d68 P 85428bb83727477d8e2662ad0c2fe885: Deleting consensus metadata
I20260808 05:55:04.864260 7927 catalog_manager.cc:4841] TS 85428bb83727477d8e2662ad0c2fe885 (127.2.191.67:46561): tablet d882b842afd8499aa386eb24aa7c8d68 (table test-table [id=a4a52c3f4f2c4a6f886d0d57cc30b27c]) successfully deleted
W20260808 05:55:04.865406 7928 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:45785 (error 108)
I20260808 05:55:04.866581 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.866226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:45785 (local address 127.0.0.1:55842)
0808 05:55:04.866414 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.866485 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:45785: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107}
I20260808 05:55:04.866582 8482 ts_tablet_manager.cc:1905] T d882b842afd8499aa386eb24aa7c8d68 P a4394cb2ad4f4d3fafa013cae78a422f: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 05:55:04.866761 7928 catalog_manager.cc:4584] TS eb6c3f13dbb343b5bea01d2a5fac1dc9 (127.2.191.65:45785): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d882b842afd8499aa386eb24aa7c8d68: Network error: Client connection negotiation failed: client connection to 127.2.191.65:45785: connect: Connection refused (error 111)
I20260808 05:55:04.868609 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 8152
I20260808 05:55:04.877382 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 8301
I20260808 05:55:04.877653 8451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:04.877274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:35203 (local address 127.0.0.1:53936)
0808 05:55:04.877457 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:04.877526 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.66:35203: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 05:55:04.885743 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 7910
2026-08-08T05:55:04Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (1205 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 05:55:04.910660 2813 mini_oidc.cc:152] Starting JWKS server
I20260808 05:55:04.912370 2813 webserver.cc:460] Webserver started at https://127.0.0.1:41393/ using document root <none> and password file <none>
I20260808 05:55:04.912516 2813 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:55:04.912817 2813 webserver.cc:460] Webserver started at http://127.0.0.1:44403/ using document root <none> and password file <none>
2026-08-08T05:55:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:04Z Disabled control of system clock
I20260808 05:55:04.923637 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:39419
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:41157
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:39419
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41393/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/testchainca.cert with env {}
W20260808 05:55:05.039674 8489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:05.039973 8489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:05.040016 8489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:05.044291 8489 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:05.044373 8489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:05.044389 8489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:05.044406 8489 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:05.044421 8489 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:55:05.044437 8489 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:55:05.044494 8489 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41393/jwks.json
I20260808 05:55:05.050411 8489 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:41157
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:39419
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:39419
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41393/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8489
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:05.051649 8489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:05.052821 8489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:05.062139 8496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:05.062193 8498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:05.062147 8494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:05.062366 8489 server_base.cc:1034] running on GCE node
I20260808 05:55:05.063076 8489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:05.064319 8489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:05.065523 8489 hybrid_clock.cc:648] HybridClock initialized: now 1786168505065462 us; error 75 us; skew 500 ppm
I20260808 05:55:05.067693 8489 webserver.cc:460] Webserver started at http://127.2.191.126:33179/ using document root <none> and password file <none>
I20260808 05:55:05.068323 8489 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:05.068423 8489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:05.068668 8489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:05.070876 8489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "1c0bc019909247e78032c82c06e1a033"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "e18f07747595c9029d898310e583f88f"
server_key_iv: "661f78ae8d9cb5c5d6a125a1e7007e0d"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.071483 8489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "1c0bc019909247e78032c82c06e1a033"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "e18f07747595c9029d898310e583f88f"
server_key_iv: "661f78ae8d9cb5c5d6a125a1e7007e0d"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.075525 8489 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 05:55:05.078490 8504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:05.079912 8489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:05.080152 8489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "1c0bc019909247e78032c82c06e1a033"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "e18f07747595c9029d898310e583f88f"
server_key_iv: "661f78ae8d9cb5c5d6a125a1e7007e0d"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.080298 8489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:05.097993 8489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:05.098834 8489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:05.099056 8489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:05.106993 8489 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:39419
I20260808 05:55:05.107098 8566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:39419 every 8 connection(s)
I20260808 05:55:05.108098 8489 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:05.110438 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 8489
I20260808 05:55:05.110693 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:05.110980 2813 external_mini_cluster.cc:1428] Setting key cba52d5e5fbfe328b7a3a93acfa9d2a5
I20260808 05:55:05.112114 8567 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:05.119731 8567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033: Bootstrap starting.
I20260808 05:55:05.122339 8571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:05.112448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42086 (local address 127.2.191.126:39419)
0808 05:55:05.113234 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:05.113256 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:05.113303 (+ 47us) server_negotiation.cc:407] Connection header received
0808 05:55:05.114221 (+ 918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:05.114245 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:05.114767 (+ 522us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:05.115249 (+ 482us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:05.115757 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.117256 (+ 1499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.118207 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.118929 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.119112 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.120017 (+ 905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:05.120024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:05.120040 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:05.120574 (+ 534us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:05.120650 (+ 76us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:05.120680 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:05.120824 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:05.121011 (+ 187us) server_negotiation.cc:299] Negotiation successful
0808 05:55:05.121327 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":134,"threads_started":1}
I20260808 05:55:05.122843 8567 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:05.123832 8567 log.cc:824] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:05.125896 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:55:05.126621 8567 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033: No bootstrap required, opened a new log
I20260808 05:55:05.130841 8567 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0bc019909247e78032c82c06e1a033" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39419 } }
I20260808 05:55:05.131124 8567 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:05.131171 8567 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c0bc019909247e78032c82c06e1a033, State: Initialized, Role: FOLLOWER
I20260808 05:55:05.131563 8567 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0bc019909247e78032c82c06e1a033" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39419 } }
I20260808 05:55:05.131676 8567 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:05.131724 8567 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:05.131798 8567 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:05.132905 8567 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0bc019909247e78032c82c06e1a033" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39419 } }
I20260808 05:55:05.133240 8567 leader_election.cc:302] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c0bc019909247e78032c82c06e1a033; no voters:
I20260808 05:55:05.133533 8567 leader_election.cc:288] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:05.133683 8573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:05.133947 8573 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [term 1 LEADER]: Becoming Leader. State: Replica: 1c0bc019909247e78032c82c06e1a033, State: Running, Role: LEADER
I20260808 05:55:05.134267 8573 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0bc019909247e78032c82c06e1a033" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39419 } }
I20260808 05:55:05.134946 8567 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:05.136130 8574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c0bc019909247e78032c82c06e1a033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0bc019909247e78032c82c06e1a033" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39419 } } }
I20260808 05:55:05.136293 8574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:05.136683 8583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:05.137751 8575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c0bc019909247e78032c82c06e1a033. Latest consensus state: current_term: 1 leader_uuid: "1c0bc019909247e78032c82c06e1a033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c0bc019909247e78032c82c06e1a033" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 39419 } } }
I20260808 05:55:05.137861 8575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:05.139660 8583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:05.145933 8583 catalog_manager.cc:1347] Generated new cluster ID: 4036484937fc443983f0a03a5ac286eb
I20260808 05:55:05.146018 8583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:05.156129 8583 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:05.157518 8583 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:05.163869 8583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c0bc019909247e78032c82c06e1a033: Generated new TSK 0
I20260808 05:55:05.164778 8583 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 05:55:05.208400 8601 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 05:55:05.208611 8601 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 05:55:05.209196 8571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:05.181949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42094 (local address 127.2.191.126:39419)
0808 05:55:05.182110 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:05.182115 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:05.182334 (+ 219us) server_negotiation.cc:407] Connection header received
0808 05:55:05.182556 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:05.182558 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:05.182608 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:05.182694 (+ 86us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:55:05.183005 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.183600 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.184959 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.185339 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.185458 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.185859 (+ 401us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:55:05.208630 (+ 22771us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41393/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 05:55:05.209014 (+ 384us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42094: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41393/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 05:55:05.209316 8571 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42094: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41393/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 05:55:05.210565 8600 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:05.181856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:39419 (local address 127.0.0.1:42094)
0808 05:55:05.182242 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:05.182258 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:05.182395 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:05.182737 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:05.182740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:05.182749 (+ 9us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:55:05.182890 (+ 141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:05.182897 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.183718 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.183722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:05.184841 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:05.184853 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.185509 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.185513 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:05.185620 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.185676 (+ 56us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:55:05.208937 (+ 23261us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41393/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 05:55:05.209211 (+ 274us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.2.191.126:39419: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41393/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":103,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.2.191.126:39419: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41393/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 05:55:05.211392 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 8489
2026-08-08T05:55:05Z chronyd exiting
I20260808 05:55:05.252214 2813 test_util.cc:175] -----------------------------------------------
I20260808 05:55:05.252305 2813 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786168478015505-2813-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (343 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 05:55:05.253505 2813 mini_oidc.cc:152] Starting JWKS server
I20260808 05:55:05.254345 2813 webserver.cc:460] Webserver started at https://127.0.0.1:37911/ using document root <none> and password file <none>
I20260808 05:55:05.254424 2813 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:55:05.254621 2813 webserver.cc:460] Webserver started at http://127.0.0.1:45765/ using document root <none> and password file <none>
2026-08-08T05:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:05Z Disabled control of system clock
I20260808 05:55:05.264940 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:40225
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:38009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:40225
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37911/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/testchainca.cert with env {}
W20260808 05:55:05.378473 8609 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:05.378768 8609 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:05.378810 8609 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:05.383055 8609 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:05.383124 8609 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:05.383139 8609 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:05.383158 8609 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:05.383174 8609 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:55:05.383190 8609 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:55:05.383203 8609 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37911/jwks.json
I20260808 05:55:05.388955 8609 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:40225
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:40225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37911/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8609
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:05.390060 8609 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:05.391079 8609 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:05.399994 8617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:05.400003 8614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:05.400003 8615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:05.400333 8609 server_base.cc:1034] running on GCE node
I20260808 05:55:05.401160 8609 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:05.402253 8609 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:05.403425 8609 hybrid_clock.cc:648] HybridClock initialized: now 1786168505403439 us; error 59 us; skew 500 ppm
I20260808 05:55:05.405457 8609 webserver.cc:460] Webserver started at http://127.2.191.126:34791/ using document root <none> and password file <none>
I20260808 05:55:05.406077 8609 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:05.406143 8609 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:05.406414 8609 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:05.408507 8609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "248b70a679f7463c80060e9e2c9516b8"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "e2aa27e67d786a0ae039ebe381be6fde"
server_key_iv: "61e20a223149a986a6298300185bd40d"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.409176 8609 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "248b70a679f7463c80060e9e2c9516b8"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "e2aa27e67d786a0ae039ebe381be6fde"
server_key_iv: "61e20a223149a986a6298300185bd40d"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.412984 8609 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:55:05.415453 8623 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:05.416776 8609 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:05.416927 8609 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "248b70a679f7463c80060e9e2c9516b8"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "e2aa27e67d786a0ae039ebe381be6fde"
server_key_iv: "61e20a223149a986a6298300185bd40d"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.417058 8609 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:05.446489 8609 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:05.447264 8609 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:05.447499 8609 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:05.454986 8609 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:40225
I20260808 05:55:05.455015 8678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:40225 every 8 connection(s)
I20260808 05:55:05.456012 8609 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:05.459131 8679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:05.461581 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 8609
I20260808 05:55:05.461687 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:05.461992 2813 external_mini_cluster.cc:1428] Setting key c8800dcc57524020ca13c1c9ab9445f4
I20260808 05:55:05.465288 8679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8: Bootstrap starting.
I20260808 05:55:05.467567 8679 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:05.468330 8679 log.cc:824] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:05.470697 8679 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8: No bootstrap required, opened a new log
I20260808 05:55:05.471401 8682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:05.463287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49234 (local address 127.2.191.126:40225)
0808 05:55:05.463900 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:05.463917 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:05.463952 (+ 35us) server_negotiation.cc:407] Connection header received
0808 05:55:05.464667 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:05.464684 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:05.465170 (+ 486us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:05.465511 (+ 341us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:05.465972 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.466941 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.467909 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.468394 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.468570 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.469584 (+ 1014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:05.469602 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:05.469615 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:05.470008 (+ 393us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:05.470064 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:05.470084 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:05.470165 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:05.470333 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 05:55:05.470640 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":263,"thread_start_us":131,"threads_started":1}
I20260808 05:55:05.474376 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:55:05.474596 8679 raft_consensus.cc:348] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248b70a679f7463c80060e9e2c9516b8" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40225 } }
I20260808 05:55:05.474819 8679 raft_consensus.cc:374] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:05.474891 8679 raft_consensus.cc:729] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 248b70a679f7463c80060e9e2c9516b8, State: Initialized, Role: FOLLOWER
I20260808 05:55:05.475343 8679 consensus_queue.cc:260] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248b70a679f7463c80060e9e2c9516b8" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40225 } }
I20260808 05:55:05.475535 8679 raft_consensus.cc:388] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:05.475631 8679 raft_consensus.cc:482] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:05.475730 8679 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:05.476881 8679 raft_consensus.cc:504] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248b70a679f7463c80060e9e2c9516b8" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40225 } }
I20260808 05:55:05.477216 8679 leader_election.cc:302] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 248b70a679f7463c80060e9e2c9516b8; no voters:
I20260808 05:55:05.477587 8679 leader_election.cc:288] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:05.477723 8684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:05.477972 8684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [term 1 LEADER]: Becoming Leader. State: Replica: 248b70a679f7463c80060e9e2c9516b8, State: Running, Role: LEADER
I20260808 05:55:05.478308 8684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248b70a679f7463c80060e9e2c9516b8" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40225 } }
I20260808 05:55:05.478868 8679 sys_catalog.cc:564] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:05.479449 8686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 248b70a679f7463c80060e9e2c9516b8. Latest consensus state: current_term: 1 leader_uuid: "248b70a679f7463c80060e9e2c9516b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248b70a679f7463c80060e9e2c9516b8" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40225 } } }
I20260808 05:55:05.479578 8686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:05.479862 8685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "248b70a679f7463c80060e9e2c9516b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "248b70a679f7463c80060e9e2c9516b8" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40225 } } }
I20260808 05:55:05.480006 8685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:05.480350 8691 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:05.483757 8691 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:05.489642 8691 catalog_manager.cc:1347] Generated new cluster ID: 3973722f6c354dd68a1c4823eb4e7724
I20260808 05:55:05.489715 8691 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:05.501816 8691 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:05.502770 8691 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:05.514454 8691 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 248b70a679f7463c80060e9e2c9516b8: Generated new TSK 0
I20260808 05:55:05.515355 8691 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 05:55:05.551409 8712 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 05:55:05.551523 8712 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 05:55:05.552204 8682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:05.536201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49246 (local address 127.2.191.126:40225)
0808 05:55:05.536358 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:05.536363 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:05.536579 (+ 216us) server_negotiation.cc:407] Connection header received
0808 05:55:05.536795 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:05.536798 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:05.536849 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:05.536941 (+ 92us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:55:05.537221 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.537786 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.539035 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.539250 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.539327 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.539669 (+ 342us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:55:05.551836 (+ 12167us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 05:55:05.552078 (+ 242us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49246: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 05:55:05.552297 8682 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49246: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 05:55:05.552469 8711 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:05.536142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40225 (local address 127.0.0.1:49246)
0808 05:55:05.536479 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:05.536495 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:05.536621 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:05.536971 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:05.536974 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:05.536984 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:55:05.537108 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:05.537115 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.537898 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.537902 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:05.538913 (+ 1011us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:05.538924 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.539364 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.539368 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:05.539473 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.539501 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:55:05.552062 (+ 12561us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 05:55:05.552270 (+ 208us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.2.191.126:40225: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37911/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":124,"threads_started":1}
I20260808 05:55:05.553179 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 8609
2026-08-08T05:55:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (342 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 05:55:05.595710 2813 mini_oidc.cc:152] Starting JWKS server
I20260808 05:55:05.596638 2813 webserver.cc:460] Webserver started at https://127.0.0.1:45781/ using document root <none> and password file <none>
I20260808 05:55:05.596777 2813 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:55:05.597119 2813 webserver.cc:460] Webserver started at http://127.0.0.1:38715/ using document root <none> and password file <none>
2026-08-08T05:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:05Z Disabled control of system clock
I20260808 05:55:05.607085 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:35445
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:37695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:35445
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45781/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 05:55:05.720943 8718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:05.721215 8718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:05.721256 8718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:05.725272 8718 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:05.725337 8718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:05.725351 8718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:05.725368 8718 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:05.725384 8718 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:55:05.725400 8718 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:55:05.725414 8718 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45781/jwks.json
I20260808 05:55:05.730201 8718 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:37695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:35445
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:35445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45781/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:05.731271 8718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:05.732630 8718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:55:05.741550 8718 server_base.cc:1034] running on GCE node
W20260808 05:55:05.741501 8724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:05.741518 8723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:05.741501 8726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:05.742426 8718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:05.743619 8718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:05.744808 8718 hybrid_clock.cc:648] HybridClock initialized: now 1786168505744783 us; error 32 us; skew 500 ppm
I20260808 05:55:05.746874 8718 webserver.cc:460] Webserver started at http://127.2.191.126:42595/ using document root <none> and password file <none>
I20260808 05:55:05.747483 8718 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:05.747582 8718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:05.747845 8718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:05.750029 8718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "d59c79065d914b7d9293fc39df947370"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "3b99a7e4f0f52e06cfb569d1c6aaa151"
server_key_iv: "9547242766d029669c387c2b5d34733b"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.750615 8718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "d59c79065d914b7d9293fc39df947370"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "3b99a7e4f0f52e06cfb569d1c6aaa151"
server_key_iv: "9547242766d029669c387c2b5d34733b"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.754412 8718 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:05.756850 8732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:05.758102 8718 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:55:05.758244 8718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "d59c79065d914b7d9293fc39df947370"
format_stamp: "Formatted at 2026-08-08 05:55:05 on dist-test-slave-qg60"
server_key: "3b99a7e4f0f52e06cfb569d1c6aaa151"
server_key_iv: "9547242766d029669c387c2b5d34733b"
server_key_version: "encryptionkey@0"
I20260808 05:55:05.758361 8718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:05.775146 8718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:05.775971 8718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:05.776219 8718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:05.783941 8718 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:35445
I20260808 05:55:05.783969 8789 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:35445 every 8 connection(s)
I20260808 05:55:05.785084 8718 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:05.788436 8790 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:05.793661 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 8718
I20260808 05:55:05.793797 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:05.794094 2813 external_mini_cluster.cc:1428] Setting key 11b38dcedadf042ce59f43fbec808b7b
I20260808 05:55:05.794461 8790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370: Bootstrap starting.
I20260808 05:55:05.797013 8790 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:05.797866 8790 log.cc:824] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:05.800246 8790 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370: No bootstrap required, opened a new log
I20260808 05:55:05.805161 8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:05.795540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52820 (local address 127.2.191.126:35445)
0808 05:55:05.796247 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:05.796262 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:05.796301 (+ 39us) server_negotiation.cc:407] Connection header received
0808 05:55:05.797106 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:05.797134 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:05.797631 (+ 497us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:05.797936 (+ 305us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:05.798413 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.799942 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.800960 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.801693 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.801869 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.802691 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:05.802698 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:05.802715 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:05.803259 (+ 544us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:05.803336 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:05.803365 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:05.803478 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:05.803615 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:55:05.803941 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":157,"threads_started":1}
I20260808 05:55:05.805373 8790 raft_consensus.cc:348] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c79065d914b7d9293fc39df947370" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35445 } }
I20260808 05:55:05.805666 8790 raft_consensus.cc:374] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:05.805734 8790 raft_consensus.cc:729] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c79065d914b7d9293fc39df947370, State: Initialized, Role: FOLLOWER
I20260808 05:55:05.806249 8790 consensus_queue.cc:260] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c79065d914b7d9293fc39df947370" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35445 } }
I20260808 05:55:05.806421 8790 raft_consensus.cc:388] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:05.806521 8790 raft_consensus.cc:482] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:05.806658 8790 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:05.807916 8790 raft_consensus.cc:504] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c79065d914b7d9293fc39df947370" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35445 } }
I20260808 05:55:05.808284 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:55:05.808292 8790 leader_election.cc:302] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d59c79065d914b7d9293fc39df947370; no voters:
I20260808 05:55:05.808704 8790 leader_election.cc:288] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:05.808835 8795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:05.809191 8795 raft_consensus.cc:686] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [term 1 LEADER]: Becoming Leader. State: Replica: d59c79065d914b7d9293fc39df947370, State: Running, Role: LEADER
I20260808 05:55:05.809751 8795 consensus_queue.cc:237] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c79065d914b7d9293fc39df947370" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35445 } }
I20260808 05:55:05.810238 8790 sys_catalog.cc:564] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:05.810972 8795 sys_catalog.cc:455] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d59c79065d914b7d9293fc39df947370. Latest consensus state: current_term: 1 leader_uuid: "d59c79065d914b7d9293fc39df947370" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c79065d914b7d9293fc39df947370" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35445 } } }
I20260808 05:55:05.811090 8795 sys_catalog.cc:458] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:05.811504 8796 sys_catalog.cc:455] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d59c79065d914b7d9293fc39df947370" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c79065d914b7d9293fc39df947370" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35445 } } }
I20260808 05:55:05.811633 8796 sys_catalog.cc:458] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370 [sys.catalog]: This master's current role is: LEADER
W20260808 05:55:05.814880 8810 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:55:05.814970 8810 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:55:05.815073 8804 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:05.815943 8804 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:05.821960 8804 catalog_manager.cc:1347] Generated new cluster ID: 824c000c5da74266971bb175fde3d33a
I20260808 05:55:05.822041 8804 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:05.838351 8804 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:05.839323 8804 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:05.846036 8804 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d59c79065d914b7d9293fc39df947370: Generated new TSK 0
I20260808 05:55:05.846797 8804 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:55:05.866044 8793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:05.860969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52822 (local address 127.2.191.126:35445)
0808 05:55:05.861123 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:05.861128 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:05.861300 (+ 172us) server_negotiation.cc:407] Connection header received
0808 05:55:05.861487 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:05.861489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:05.861541 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:05.861626 (+ 85us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:55:05.861903 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.862581 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.863576 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.863810 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.863927 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.864248 (+ 321us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:55:05.865675 (+ 1427us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45781/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 05:55:05.865904 (+ 229us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52822: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45781/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 05:55:05.866119 8793 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52822: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45781/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 05:55:05.867871 8820 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:05.860896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:35445 (local address 127.0.0.1:52822)
0808 05:55:05.861202 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:05.861218 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:05.861339 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:05.861655 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:05.861659 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:05.861667 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:55:05.861787 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:05.861794 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.862726 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.862730 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:05.863455 (+ 725us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:05.863464 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:05.863943 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:05.863948 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:05.864039 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:05.864061 (+ 22us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:55:05.865859 (+ 1798us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45781/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 05:55:05.867685 (+ 1826us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.2.191.126:35445: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45781/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":209,"mutex_wait_us":1611,"thread_start_us":116,"threads_started":1}
I20260808 05:55:05.868420 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 8718
E20260808 05:55:05.878921 8821 webserver.cc:533] Webserver: sslize failed:
E20260808 05:55:05.879024 8821 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T05:55:05Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (314 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T05:55:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:05Z Disabled control of system clock
I20260808 05:55:05.920181 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33181
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:45653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:33181
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/testchainca.cert with env {}
W20260808 05:55:06.036537 8826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:06.036854 8826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:06.036895 8826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:06.041041 8826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:06.041108 8826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:06.041124 8826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:06.041141 8826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:06.041157 8826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:55:06.041215 8826 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:55:06.041234 8826 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 05:55:06.046801 8826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:45653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:33181
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:06.047937 8826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:06.049044 8826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:06.058012 8832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:06.058020 8831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:06.058032 8826 server_base.cc:1034] running on GCE node
W20260808 05:55:06.058048 8834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:06.058923 8826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:06.060177 8826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:06.061406 8826 hybrid_clock.cc:648] HybridClock initialized: now 1786168506061378 us; error 44 us; skew 500 ppm
I20260808 05:55:06.063653 8826 webserver.cc:460] Webserver started at http://127.2.191.126:44515/ using document root <none> and password file <none>
I20260808 05:55:06.064275 8826 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:06.064375 8826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:06.064622 8826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:06.066795 8826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "55adde85555344babdafd4816be5dd3b"
format_stamp: "Formatted at 2026-08-08 05:55:06 on dist-test-slave-qg60"
server_key: "7ce3425fe753199d578a70796345169a"
server_key_iv: "2bf2f0fade0ce5bc7524d0b64bedead2"
server_key_version: "encryptionkey@0"
I20260808 05:55:06.067408 8826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "55adde85555344babdafd4816be5dd3b"
format_stamp: "Formatted at 2026-08-08 05:55:06 on dist-test-slave-qg60"
server_key: "7ce3425fe753199d578a70796345169a"
server_key_iv: "2bf2f0fade0ce5bc7524d0b64bedead2"
server_key_version: "encryptionkey@0"
I20260808 05:55:06.071612 8826 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:55:06.074185 8840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:06.075420 8826 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:55:06.075598 8826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "55adde85555344babdafd4816be5dd3b"
format_stamp: "Formatted at 2026-08-08 05:55:06 on dist-test-slave-qg60"
server_key: "7ce3425fe753199d578a70796345169a"
server_key_iv: "2bf2f0fade0ce5bc7524d0b64bedead2"
server_key_version: "encryptionkey@0"
I20260808 05:55:06.075727 8826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:06.101199 8826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:06.101963 8826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:06.102211 8826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:06.109555 8826 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:33181
I20260808 05:55:06.109561 8895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:33181 every 8 connection(s)
I20260808 05:55:06.110559 8826 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:06.113754 8896 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:06.116947 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 8826
I20260808 05:55:06.117085 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:06.117398 2813 external_mini_cluster.cc:1428] Setting key 56c96875cd7933b77da05a53496f3cb0
I20260808 05:55:06.119900 8896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b: Bootstrap starting.
I20260808 05:55:06.122154 8896 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:06.122903 8896 log.cc:824] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:06.124842 8896 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b: No bootstrap required, opened a new log
I20260808 05:55:06.126806 8900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:06.118790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51242 (local address 127.2.191.126:33181)
0808 05:55:06.119441 (+ 651us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:06.119461 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:06.119497 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:55:06.120205 (+ 708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:06.120243 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:06.120774 (+ 531us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:06.121117 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:06.121569 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:06.122601 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:06.123542 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:06.124005 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:06.124180 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:06.125098 (+ 918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:06.125105 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:06.125127 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:06.125520 (+ 393us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:06.125585 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:06.125605 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:06.125721 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:06.125836 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 05:55:06.126096 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":137,"threads_started":1}
I20260808 05:55:06.128500 8896 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adde85555344babdafd4816be5dd3b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33181 } }
I20260808 05:55:06.128845 8896 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:06.128958 8896 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55adde85555344babdafd4816be5dd3b, State: Initialized, Role: FOLLOWER
I20260808 05:55:06.129432 8896 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adde85555344babdafd4816be5dd3b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33181 } }
I20260808 05:55:06.129592 8896 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:06.129671 8896 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:06.129766 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:55:06.129781 8896 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:06.130822 8896 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adde85555344babdafd4816be5dd3b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33181 } }
I20260808 05:55:06.131166 8896 leader_election.cc:302] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55adde85555344babdafd4816be5dd3b; no voters:
I20260808 05:55:06.131551 8896 leader_election.cc:288] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:06.131664 8902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:06.131917 8902 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [term 1 LEADER]: Becoming Leader. State: Replica: 55adde85555344babdafd4816be5dd3b, State: Running, Role: LEADER
I20260808 05:55:06.132242 8902 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adde85555344babdafd4816be5dd3b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33181 } }
I20260808 05:55:06.132901 8896 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:06.133950 8904 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55adde85555344babdafd4816be5dd3b. Latest consensus state: current_term: 1 leader_uuid: "55adde85555344babdafd4816be5dd3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adde85555344babdafd4816be5dd3b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33181 } } }
I20260808 05:55:06.134096 8904 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:06.134487 8912 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:06.134702 8903 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55adde85555344babdafd4816be5dd3b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55adde85555344babdafd4816be5dd3b" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33181 } } }
I20260808 05:55:06.134832 8903 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:06.137624 8912 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:06.143289 8912 catalog_manager.cc:1347] Generated new cluster ID: f5b70bb89c8a49fca236ab2a303a9bb3
I20260808 05:55:06.143371 8912 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:06.164149 8912 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:06.165155 8912 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:06.170867 8912 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55adde85555344babdafd4816be5dd3b: Generated new TSK 0
I20260808 05:55:06.171730 8912 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:55:06.275197 8900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:06.191835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51254 (local address 127.2.191.126:33181)
0808 05:55:06.192070 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:06.192074 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:06.192272 (+ 198us) server_negotiation.cc:407] Connection header received
0808 05:55:06.192420 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:06.192422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:06.192471 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:06.192564 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:55:06.192842 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:06.193384 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:06.194620 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:06.194849 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:06.194922 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:06.195256 (+ 334us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:55:06.274764 (+ 79508us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 05:55:06.275046 (+ 282us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51254: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 05:55:06.275314 8900 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51254: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 05:55:06.275525 8931 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:06.191735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33181 (local address 127.0.0.1:51254)
0808 05:55:06.192163 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:06.192178 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:06.192298 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:06.192591 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:06.192594 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:06.192602 (+ 8us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:55:06.192721 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:06.192751 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:06.193493 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:06.193496 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:06.194480 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:06.194490 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:06.194964 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:06.194968 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:06.195065 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:06.195094 (+ 29us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:55:06.275071 (+ 79977us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 05:55:06.275327 (+ 256us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.2.191.126:33181: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":146,"threads_started":1}
I20260808 05:55:06.276166 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 8826
2026-08-08T05:55:06Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (387 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (129 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (131 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:55:06 dist-test-slave-qg60 krb5kdc[8943](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:55:06 dist-test-slave-qg60 krb5kdc[8943](info): set up 2 sockets
Aug 08 05:55:06 dist-test-slave-qg60 krb5kdc[8943](info): commencing operation
krb5kdc: starting...
W20260808 05:55:07.636603 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.005s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:07 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:55:07.780678 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34423
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:34423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:07.896433 8957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:07.896816 8957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:07.896929 8957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:07.901043 8957 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:07.901160 8957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:07.901197 8957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:07.901238 8957 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:07.901273 8957 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:07.906787 8957 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:34423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:07.907959 8957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:07.909061 8957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:55:07.918133 8957 server_base.cc:1034] running on GCE node
W20260808 05:55:07.918108 8963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:07.918175 8962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:07.918156 8966 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:07.919050 8957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:07.920203 8957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:07.921388 8957 hybrid_clock.cc:648] HybridClock initialized: now 1786168507921369 us; error 32 us; skew 500 ppm
Aug 08 05:55:07 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168507, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:07.927779 8957 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:55:07.928846 8957 webserver.cc:460] Webserver started at http://127.2.191.126:46421/ using document root <none> and password file <none>
I20260808 05:55:07.929409 8957 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:07.929471 8957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:07.929658 8957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:07.931744 8957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "e6c48f9e281243238e3f60eeb8d4452f"
format_stamp: "Formatted at 2026-08-08 05:55:07 on dist-test-slave-qg60"
server_key: "47ff9eb9d06ab94ec26a767ba2487e2b"
server_key_iv: "b2e914c0dcaf79d302c51bcce61880e8"
server_key_version: "encryptionkey@0"
I20260808 05:55:07.932260 8957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "e6c48f9e281243238e3f60eeb8d4452f"
format_stamp: "Formatted at 2026-08-08 05:55:07 on dist-test-slave-qg60"
server_key: "47ff9eb9d06ab94ec26a767ba2487e2b"
server_key_iv: "b2e914c0dcaf79d302c51bcce61880e8"
server_key_version: "encryptionkey@0"
I20260808 05:55:07.936271 8957 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:55:07.939028 8973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:07.940357 8957 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:07.940527 8957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "e6c48f9e281243238e3f60eeb8d4452f"
format_stamp: "Formatted at 2026-08-08 05:55:07 on dist-test-slave-qg60"
server_key: "47ff9eb9d06ab94ec26a767ba2487e2b"
server_key_iv: "b2e914c0dcaf79d302c51bcce61880e8"
server_key_version: "encryptionkey@0"
I20260808 05:55:07.940665 8957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:07.953325 8957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:07.956207 8957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:07.956421 8957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:07.964161 8957 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:34423
I20260808 05:55:07.964191 9029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:34423 every 8 connection(s)
I20260808 05:55:07.965256 8957 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:07.968194 9031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:07.968668 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 8957
I20260808 05:55:07.968818 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:07.969165 2813 external_mini_cluster.cc:1428] Setting key 6dd5b493fa409364e8405c5188625401
I20260808 05:55:07.975392 9031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f: Bootstrap starting.
I20260808 05:55:07.978101 9031 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f: Neither blocks nor log segments found. Creating new log.
Aug 08 05:55:07 dist-test-slave-qg60 krb5kdc[8943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:07.979139 9031 log.cc:824] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:07.981758 9031 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f: No bootstrap required, opened a new log
I20260808 05:55:07.984337 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:07.970753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53526 (local address 127.2.191.126:34423)
0808 05:55:07.971245 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:07.971261 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:07.971298 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:55:07.972011 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:07.972030 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:07.972381 (+ 351us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:07.972733 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:07.973641 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:07.974618 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:07.975487 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:07.976015 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:07.976219 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:07.979261 (+ 3042us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:07.979266 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:07.979282 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:07.979342 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:07.981248 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:07.981799 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:07.981803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:07.981809 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:07.981972 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:07.982300 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:07.982302 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:07.982303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:07.982718 (+ 415us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:07.982868 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:07.983196 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 05:55:07.983511 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":153,"threads_started":1}
I20260808 05:55:07.985970 9031 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c48f9e281243238e3f60eeb8d4452f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34423 } }
I20260808 05:55:07.986243 9031 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:07.986333 9031 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c48f9e281243238e3f60eeb8d4452f, State: Initialized, Role: FOLLOWER
I20260808 05:55:07.986848 9031 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c48f9e281243238e3f60eeb8d4452f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34423 } }
I20260808 05:55:07.987031 9031 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:07.987105 9031 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:07.987212 9031 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:07.988221 9031 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c48f9e281243238e3f60eeb8d4452f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34423 } }
I20260808 05:55:07.988579 9031 leader_election.cc:302] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6c48f9e281243238e3f60eeb8d4452f; no voters:
I20260808 05:55:07.988961 9031 leader_election.cc:288] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:07.989078 9036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:07.989352 9036 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [term 1 LEADER]: Becoming Leader. State: Replica: e6c48f9e281243238e3f60eeb8d4452f, State: Running, Role: LEADER
I20260808 05:55:07.989768 9036 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c48f9e281243238e3f60eeb8d4452f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34423 } }
I20260808 05:55:07.990310 9031 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:07.991721 9038 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6c48f9e281243238e3f60eeb8d4452f. Latest consensus state: current_term: 1 leader_uuid: "e6c48f9e281243238e3f60eeb8d4452f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c48f9e281243238e3f60eeb8d4452f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34423 } } }
I20260808 05:55:07.991734 9037 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6c48f9e281243238e3f60eeb8d4452f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c48f9e281243238e3f60eeb8d4452f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34423 } } }
I20260808 05:55:07.991861 9038 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:07.991888 9037 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:07.993039 9045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:07.995893 9045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:08.002620 9045 catalog_manager.cc:1347] Generated new cluster ID: 4728e39fb83143b1be63712912fe2037
I20260808 05:55:08.002760 9045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:08.015944 9045 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:08.017082 9045 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:08.034514 9045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6c48f9e281243238e3f60eeb8d4452f: Generated new TSK 0
I20260808 05:55:08.035411 9045 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:55:08.072288 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34423
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:08.192269 9058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:08.192548 9058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:08.192620 9058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:08.196837 9058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:08.196915 9058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:08.197018 9058 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:08.202544 9058 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:08.203704 9058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:08.204810 9058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:08.214864 9065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:08.214849 9064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:08.214846 9068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:08.215040 9058 server_base.cc:1034] running on GCE node
I20260808 05:55:08.215538 9058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:08.216287 9058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:08.217516 9058 hybrid_clock.cc:648] HybridClock initialized: now 1786168508217496 us; error 34 us; skew 500 ppm
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.220366 9058 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:55:08.221362 9058 webserver.cc:460] Webserver started at http://127.2.191.65:45687/ using document root <none> and password file <none>
I20260808 05:55:08.221961 9058 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:08.222059 9058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:08.222299 9058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:08.224843 9058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "f2edcf87bd344221b6dfe9238dcd3982"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "52e577d01a24d3915ac05a81a8385418"
server_key_iv: "84d544a7c5f66c8955240031374d510f"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.225558 9058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "f2edcf87bd344221b6dfe9238dcd3982"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "52e577d01a24d3915ac05a81a8385418"
server_key_iv: "84d544a7c5f66c8955240031374d510f"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.230086 9058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s
I20260808 05:55:08.232841 9077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.234138 9058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 05:55:08.234289 9058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "f2edcf87bd344221b6dfe9238dcd3982"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "52e577d01a24d3915ac05a81a8385418"
server_key_iv: "84d544a7c5f66c8955240031374d510f"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.234416 9058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:08.262915 9058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:08.266211 9058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:08.266443 9058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:08.267072 9058 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:08.267962 9058 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:08.268038 9058 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.268121 9058 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:08.268174 9058 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.277638 9058 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:41617
I20260808 05:55:08.277668 9195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:41617 every 8 connection(s)
I20260808 05:55:08.278568 9058 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:08.280586 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 9058
I20260808 05:55:08.280719 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:08.281073 2813 external_mini_cluster.cc:1428] Setting key 78cf5dfa300ef9bb70ea70ab82127e32
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:55:08.293854 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.280500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:41741 (local address 127.2.191.126:34423)
0808 05:55:08.280687 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.280692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.281699 (+ 1007us) server_negotiation.cc:407] Connection header received
0808 05:55:08.283397 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.283400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.283450 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.283536 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.284995 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.285541 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.286752 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.286998 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.287116 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.289696 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:08.289699 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:08.289702 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:08.289734 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:08.291532 (+ 1798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.292135 (+ 603us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.292139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.292141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.292241 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.292623 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.292626 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.292627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.292877 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:08.292958 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:08.293560 (+ 602us) server_negotiation.cc:299] Negotiation successful
0808 05:55:08.293720 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:55:08.294813 9198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.280979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34423 (local address 127.2.191.65:41741)
0808 05:55:08.281545 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:08.281589 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:08.283191 (+ 1602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:08.283714 (+ 523us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:08.283722 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:08.284124 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:08.284770 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:08.284793 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.285680 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.285686 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:08.286623 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:08.286632 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.287155 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.287159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:08.287334 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.287954 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:08.287970 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:08.289532 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:08.291658 (+ 2126us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:08.291664 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:08.291681 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:08.291955 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:08.292372 (+ 417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:08.292375 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:08.292376 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:08.292523 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:08.292969 (+ 446us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:08.292974 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:08.293222 (+ 248us) client_negotiation.cc:769] Sending connection context
0808 05:55:08.293393 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 05:55:08.293750 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":177,"threads_started":1}
I20260808 05:55:08.296152 9196 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34423
I20260808 05:55:08.296445 9196 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:08.297135 9196 heartbeater.cc:511] Master 127.2.191.126:34423 requested a full tablet report, sending...
I20260808 05:55:08.298928 8991 ts_manager.cc:194] Registered new tserver with Master: f2edcf87bd344221b6dfe9238dcd3982 (127.2.191.65:41617)
I20260808 05:55:08.300719 8991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:41741
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:55:08.312220 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34423
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:08.431495 9201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:08.431761 9201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:08.431806 9201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:08.435830 9201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:08.435904 9201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:08.435966 9201 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:08.441516 9201 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:08.442570 9201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:08.443615 9201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:08.453532 9209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:08.453660 9206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:08.453532 9207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:08.453764 9201 server_base.cc:1034] running on GCE node
I20260808 05:55:08.454298 9201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:08.454990 9201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:08.456207 9201 hybrid_clock.cc:648] HybridClock initialized: now 1786168508456197 us; error 32 us; skew 500 ppm
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.459198 9201 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:55:08.460116 9201 webserver.cc:460] Webserver started at http://127.2.191.66:43555/ using document root <none> and password file <none>
I20260808 05:55:08.460704 9201 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:08.460825 9201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:08.461051 9201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:08.463191 9201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "987631492e0f4038b99e13c3350a4d4f"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "865593b00362c28914132a1d4548257d"
server_key_iv: "d58ad67068cd68b555d7aec130b42027"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.463797 9201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "987631492e0f4038b99e13c3350a4d4f"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "865593b00362c28914132a1d4548257d"
server_key_iv: "d58ad67068cd68b555d7aec130b42027"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.467803 9201 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 05:55:08.470387 9218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.471753 9201 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:55:08.471910 9201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "987631492e0f4038b99e13c3350a4d4f"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "865593b00362c28914132a1d4548257d"
server_key_iv: "d58ad67068cd68b555d7aec130b42027"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.472055 9201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:08.494307 9201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:08.497465 9201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:08.497627 9201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:08.498147 9201 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:08.498957 9201 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:08.499017 9201 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.499056 9201 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:08.499079 9201 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.508180 9201 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:37069
I20260808 05:55:08.508198 9343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:37069 every 8 connection(s)
I20260808 05:55:08.509263 9201 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:08.509943 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 9201
I20260808 05:55:08.510067 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:08.510413 2813 external_mini_cluster.cc:1428] Setting key ac7fb99a2948e8a33e3900376f620f57
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:55:08.525271 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.511718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:58845 (local address 127.2.191.126:34423)
0808 05:55:08.511853 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.511857 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.513167 (+ 1310us) server_negotiation.cc:407] Connection header received
0808 05:55:08.514615 (+ 1448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.514619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.514671 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.514774 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.515956 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.516512 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.517711 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.517940 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.518060 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.521221 (+ 3161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:08.521224 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:08.521226 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:08.521251 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:08.522814 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.523450 (+ 636us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.523453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.523455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.523533 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.523935 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.523944 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.523946 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.524138 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:08.524251 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:08.524893 (+ 642us) server_negotiation.cc:299] Negotiation successful
0808 05:55:08.525036 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:55:08.526212 9346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.512426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34423 (local address 127.2.191.66:58845)
0808 05:55:08.513014 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:08.513060 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:08.514408 (+ 1348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:08.514948 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:08.514954 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:08.515322 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:08.515812 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:08.515825 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.516654 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.516658 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:08.517568 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:08.517577 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.518101 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.518106 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:08.518277 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.518968 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:08.518983 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:08.521003 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:08.523024 (+ 2021us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:08.523029 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:08.523043 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:08.523323 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:08.523663 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:08.523668 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:08.523670 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:08.523826 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:08.524248 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:08.524255 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:08.524551 (+ 296us) client_negotiation.cc:769] Sending connection context
0808 05:55:08.524840 (+ 289us) client_negotiation.cc:240] Negotiation successful
0808 05:55:08.525221 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":212,"threads_started":1}
I20260808 05:55:08.527457 9344 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34423
I20260808 05:55:08.527762 9344 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:08.528273 9344 heartbeater.cc:511] Master 127.2.191.126:34423 requested a full tablet report, sending...
I20260808 05:55:08.529407 8991 ts_manager.cc:194] Registered new tserver with Master: 987631492e0f4038b99e13c3350a4d4f (127.2.191.66:37069)
I20260808 05:55:08.530050 8991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:58845
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:55:08.544559 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34423
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:32975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:08.664096 9350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:08.664419 9350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:08.664469 9350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:08.668607 9350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:08.668700 9350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:08.668905 9350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:08.674530 9350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:32975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34423
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:08.675758 9350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:08.676923 9350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:08.686880 9359 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:08.686866 9357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:08.686894 9355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:08.687247 9350 server_base.cc:1034] running on GCE node
I20260808 05:55:08.687784 9350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:08.688444 9350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:08.689620 9350 hybrid_clock.cc:648] HybridClock initialized: now 1786168508689575 us; error 55 us; skew 500 ppm
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.693151 9350 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:55:08.694149 9350 webserver.cc:460] Webserver started at http://127.2.191.67:44065/ using document root <none> and password file <none>
I20260808 05:55:08.694790 9350 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:08.694895 9350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:08.695156 9350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:08.697526 9350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "42c244df1f0e4dc5a4b9071f8e7250d5"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "7186d8d51fc094c0cec0f0fd2f20be18"
server_key_iv: "b6eeeb85dcc293fd72cc41001bef340a"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.698202 9350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "42c244df1f0e4dc5a4b9071f8e7250d5"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "7186d8d51fc094c0cec0f0fd2f20be18"
server_key_iv: "b6eeeb85dcc293fd72cc41001bef340a"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.702636 9350 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:08.705557 9367 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.707019 9350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:08.707192 9350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "42c244df1f0e4dc5a4b9071f8e7250d5"
format_stamp: "Formatted at 2026-08-08 05:55:08 on dist-test-slave-qg60"
server_key: "7186d8d51fc094c0cec0f0fd2f20be18"
server_key_iv: "b6eeeb85dcc293fd72cc41001bef340a"
server_key_version: "encryptionkey@0"
I20260808 05:55:08.707334 9350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:08.737233 9350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:08.740911 9350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:08.741160 9350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:08.741845 9350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:08.743108 9350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:08.743201 9350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.743283 9350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:08.743324 9350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:08.756449 9350 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:38205
I20260808 05:55:08.756471 9491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:38205 every 8 connection(s)
I20260808 05:55:08.757557 9350 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:08.763209 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 9350
I20260808 05:55:08.763353 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:08.763674 2813 external_mini_cluster.cc:1428] Setting key 5bacf2ff35eabeeae4eadad7050a9432
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:08.772703 9034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.759548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:60833 (local address 127.2.191.126:34423)
0808 05:55:08.759721 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.759726 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.760757 (+ 1031us) server_negotiation.cc:407] Connection header received
0808 05:55:08.762251 (+ 1494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.762254 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.762302 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.762380 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.763858 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.764514 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.766180 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.766400 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.766485 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.769105 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:08.769127 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:08.769129 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:08.769155 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:08.770417 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.771085 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.771088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.771090 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.771189 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.771603 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.771606 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.771607 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.771816 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:08.771904 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:08.772455 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 05:55:08.772571 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 05:55:08.773638 9494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.760037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34423 (local address 127.2.191.67:60833)
0808 05:55:08.760555 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:08.760605 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:08.761990 (+ 1385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:08.762533 (+ 543us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:08.762539 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:08.762956 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:08.763702 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:08.763725 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.764772 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.764776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:08.766037 (+ 1261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:08.766050 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.766543 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.766546 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:08.766697 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.767357 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:08.767375 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:08.768941 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:08.770608 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:08.770613 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:08.770627 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:08.770898 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:08.771294 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:08.771297 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:08.771298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:08.771444 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:08.771915 (+ 471us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:08.771921 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:08.772189 (+ 268us) client_negotiation.cc:769] Sending connection context
0808 05:55:08.772351 (+ 162us) client_negotiation.cc:240] Negotiation successful
0808 05:55:08.772624 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":125,"threads_started":1}
I20260808 05:55:08.774847 9492 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34423
I20260808 05:55:08.775110 9492 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:08.775673 9492 heartbeater.cc:511] Master 127.2.191.126:34423 requested a full tablet report, sending...
I20260808 05:55:08.776870 8991 ts_manager.cc:194] Registered new tserver with Master: 42c244df1f0e4dc5a4b9071f8e7250d5 (127.2.191.67:38205)
I20260808 05:55:08.777562 8991 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:60833
I20260808 05:55:08.777956 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/test-admin.keytab.
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.797739 2813 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 05:55:08.800567 9500 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:08.799129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51654 (local address 127.2.191.65:41617)
0808 05:55:08.799416 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.799426 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.799462 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:55:08.799515 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.799520 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.799734 (+ 214us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.799865 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.800393 (+ 528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51654: BlockingRecv error: recv got EOF from 127.0.0.1:51654 (error 108)
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":111,"threads_started":1}
W20260808 05:55:08.800824 2813 init.cc:244] Error while opening credential cache '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5cc)
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.801900 2813 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.802856 2813 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:55:08.812490 9500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.803817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51656 (local address 127.2.191.65:41617)
0808 05:55:08.803948 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.803951 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.803986 (+ 35us) server_negotiation.cc:407] Connection header received
0808 05:55:08.804108 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.804111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.804153 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.804222 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.804797 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.805537 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.806340 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.806747 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.806831 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.809178 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:08.809188 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:08.809201 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:08.809224 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:08.810712 (+ 1488us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.811113 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.811118 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.811119 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.811215 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.811461 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.811463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.811464 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.811766 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:08.812016 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:08.812148 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 05:55:08.812323 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 05:55:08.816397 9500 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:08.815456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51672 (local address 127.2.191.65:41617)
0808 05:55:08.815605 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.815608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.815624 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:55:08.815752 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.815755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.815791 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.815856 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.816279 (+ 423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51672: BlockingRecv error: recv got EOF from 127.0.0.1:51672 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 05:55:08.816437 2813 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5cc' of type FILE
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.817570 2813 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.818480 2813 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:55:08.827479 9500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.819293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51676 (local address 127.2.191.65:41617)
0808 05:55:08.819432 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.819435 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.819483 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:55:08.819576 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.819579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.819622 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.819687 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.820168 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.820671 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.821497 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.821745 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.821830 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.824167 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:08.824170 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:08.824172 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:08.824194 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:08.825794 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.826246 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.826249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.826250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.826327 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.826594 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.826596 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.826597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.826778 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:08.826898 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:08.827161 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 05:55:08.827257 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260808 05:55:08.830660 9500 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:08.829623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51690 (local address 127.2.191.65:41617)
0808 05:55:08.829736 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.829739 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.829842 (+ 103us) server_negotiation.cc:407] Connection header received
0808 05:55:08.829937 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.829940 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.829979 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.830039 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.830512 (+ 473us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51690: BlockingRecv error: recv got EOF from 127.0.0.1:51690 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 05:55:08.830755 2813 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786168478015505-2813-0/krb5kdc/krb5cc' of type FILE
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.831813 2813 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:08.832808 2813 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[8943](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168508, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:55:08.841471 9500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:08.833671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51698 (local address 127.2.191.65:41617)
0808 05:55:08.833823 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:08.833826 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:08.833839 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:08.833942 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:08.833945 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:08.834047 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:08.834118 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:08.834586 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.835127 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.835887 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:08.836096 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:08.836190 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:08.838507 (+ 2317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:08.838510 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:08.838512 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:08.838534 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:08.839881 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.840272 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.840274 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.840276 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.840346 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:08.840581 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:08.840584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:08.840585 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:08.840827 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:08.840951 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:08.841141 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 05:55:08.841286 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 05:55:08.842532 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 9058
I20260808 05:55:08.851286 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 9201
I20260808 05:55:08.859628 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 9350
I20260808 05:55:08.870600 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 8957
2026-08-08T05:55:08Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2335 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[9513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[9513](info): set up 2 sockets
Aug 08 05:55:08 dist-test-slave-qg60 krb5kdc[9513](info): commencing operation
krb5kdc: starting...
W20260808 05:55:09.977877 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.082s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:10 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:10Z Disabled control of system clock
WARNING: no policy specified for oryx/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.126.keytab.
Entry for principal oryx/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.126.keytab.
I20260808 05:55:10.117120 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:36447
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.126.keytab
--principal=oryx/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:36447
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:10.235800 9527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:10.236125 9527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:10.236196 9527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:10.240404 9527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:10.240512 9527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:10.240548 9527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:10.240589 9527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:10.240629 9527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:10.246301 9527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:36447
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.126.keytab
--principal=oryx/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:36447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:10.247514 9527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:10.248591 9527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:10.257565 9532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:10.257570 9536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:10.257567 9533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:10.257789 9527 server_base.cc:1034] running on GCE node
I20260808 05:55:10.258649 9527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:10.259848 9527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:10.261020 9527 hybrid_clock.cc:648] HybridClock initialized: now 1786168510260995 us; error 44 us; skew 500 ppm
Aug 08 05:55:10 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:10.264086 9527 init.cc:377] Logged in from keytab as oryx/127.2.191.126@KRBTEST.COM (short username oryx)
I20260808 05:55:10.265116 9527 webserver.cc:460] Webserver started at http://127.2.191.126:39179/ using document root <none> and password file <none>
I20260808 05:55:10.265681 9527 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:10.265740 9527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:10.265910 9527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:10.268059 9527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "eba2996fd09d42aa8bd020146491a69d"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "3db0ba199dfb5adb949278c10d694fb6"
server_key_iv: "a4feefd2c6027477f8edaea7afdaabf0"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.268625 9527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "eba2996fd09d42aa8bd020146491a69d"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "3db0ba199dfb5adb949278c10d694fb6"
server_key_iv: "a4feefd2c6027477f8edaea7afdaabf0"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.272526 9527 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260808 05:55:10.275141 9544 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:10.276387 9527 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:55:10.276495 9527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "eba2996fd09d42aa8bd020146491a69d"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "3db0ba199dfb5adb949278c10d694fb6"
server_key_iv: "a4feefd2c6027477f8edaea7afdaabf0"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.276587 9527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:10.302526 9527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:10.305613 9527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:10.305773 9527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:10.313360 9527 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:36447
I20260808 05:55:10.313678 9599 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:36447 every 8 connection(s)
I20260808 05:55:10.314419 9527 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:10.314787 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 9527
I20260808 05:55:10.314932 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:10.315265 2813 external_mini_cluster.cc:1428] Setting key 179a9033b7d170f1beb852eb2743659c
I20260808 05:55:10.317654 9600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:10.323297 9600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: Bootstrap starting.
Aug 08 05:55:10 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:10.325829 9600 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:10.326903 9600 log.cc:824] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:10.329448 9600 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: No bootstrap required, opened a new log
I20260808 05:55:10.330271 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:10.316771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46200 (local address 127.2.191.126:36447)
0808 05:55:10.317221 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:10.317236 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:10.317273 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:55:10.318021 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:10.318042 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:10.318374 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:10.318768 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:10.319596 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.320629 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.321516 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.321994 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.322170 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:10.324827 (+ 2657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:10.324832 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:10.324845 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:10.324872 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:10.326774 (+ 1902us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:10.327327 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:10.327333 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:10.327357 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:10.327520 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:10.327868 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:10.327870 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:10.327872 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:10.328284 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:10.328446 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:10.328896 (+ 450us) server_negotiation.cc:299] Negotiation successful
0808 05:55:10.329257 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":305,"thread_start_us":141,"threads_started":1}
I20260808 05:55:10.332543 9600 raft_consensus.cc:348] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } }
I20260808 05:55:10.332835 9600 raft_consensus.cc:374] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:10.332916 9600 raft_consensus.cc:729] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eba2996fd09d42aa8bd020146491a69d, State: Initialized, Role: FOLLOWER
I20260808 05:55:10.333336 9600 consensus_queue.cc:260] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } }
I20260808 05:55:10.333488 9600 raft_consensus.cc:388] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:10.333577 9600 raft_consensus.cc:482] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:10.333678 9600 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:10.334600 9600 raft_consensus.cc:504] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } }
I20260808 05:55:10.334939 9600 leader_election.cc:302] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eba2996fd09d42aa8bd020146491a69d; no voters:
I20260808 05:55:10.335249 9600 leader_election.cc:288] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:10.335394 9605 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:10.335660 9605 raft_consensus.cc:686] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 1 LEADER]: Becoming Leader. State: Replica: eba2996fd09d42aa8bd020146491a69d, State: Running, Role: LEADER
I20260808 05:55:10.335950 9605 consensus_queue.cc:237] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } }
I20260808 05:55:10.336619 9600 sys_catalog.cc:564] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:10.337853 9607 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: New leader eba2996fd09d42aa8bd020146491a69d. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } }
I20260808 05:55:10.337872 9606 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } }
I20260808 05:55:10.338016 9607 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:10.338018 9606 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:10.338428 9615 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:10.341606 9615 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:10.347411 9615 catalog_manager.cc:1347] Generated new cluster ID: 6403146fce1047268fe96d5cdc56e645
I20260808 05:55:10.347612 9615 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:10.363102 9615 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:10.364153 9615 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:10.371093 9615 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: Generated new TSK 0
I20260808 05:55:10.371912 9615 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab.
Entry for principal oryx/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab.
I20260808 05:55:10.410315 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36447
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab
--principal=oryx/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:10.529083 9629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:10.529382 9629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:10.529472 9629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:10.533648 9629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:10.533720 9629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:10.533823 9629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:10.539803 9629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab
--principal=oryx/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:10.541002 9629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:10.542096 9629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:10.552919 9635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:10.552919 9634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:10.553157 9629 server_base.cc:1034] running on GCE node
W20260808 05:55:10.552922 9637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:10.553716 9629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:10.554483 9629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:10.555696 9629 hybrid_clock.cc:648] HybridClock initialized: now 1786168510555661 us; error 45 us; skew 500 ppm
Aug 08 05:55:10 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:10.559046 9629 init.cc:377] Logged in from keytab as oryx/127.2.191.65@KRBTEST.COM (short username oryx)
I20260808 05:55:10.560035 9629 webserver.cc:460] Webserver started at http://127.2.191.65:46869/ using document root <none> and password file <none>
I20260808 05:55:10.560669 9629 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:10.560791 9629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:10.561025 9629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:10.563201 9629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "96fe63e894c34b0d9829bc70894764c1"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "e5368896daa7baa3806ef9c88e0fa0f3"
server_key_iv: "f8af37ab809754014516f67d5258355c"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.563794 9629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "96fe63e894c34b0d9829bc70894764c1"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "e5368896daa7baa3806ef9c88e0fa0f3"
server_key_iv: "f8af37ab809754014516f67d5258355c"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.567857 9629 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 05:55:10.570626 9644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:10.571975 9629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 05:55:10.572134 9629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "96fe63e894c34b0d9829bc70894764c1"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "e5368896daa7baa3806ef9c88e0fa0f3"
server_key_iv: "f8af37ab809754014516f67d5258355c"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.572254 9629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:10.584651 9629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:10.587972 9629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:10.588238 9629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:10.588964 9629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:10.589851 9629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:10.589900 9629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:10.589973 9629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:10.590005 9629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:10.599542 9629 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:39411
I20260808 05:55:10.599566 9765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:39411 every 8 connection(s)
I20260808 05:55:10.600526 9629 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:10.608167 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 9629
I20260808 05:55:10.608309 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:10.608651 2813 external_mini_cluster.cc:1428] Setting key cf1ca2bcf08d9089aa44d3e2a4258ad9
Aug 08 05:55:10 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:10.616241 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:10.602504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:33751 (local address 127.2.191.126:36447)
0808 05:55:10.602654 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:10.602658 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:10.603448 (+ 790us) server_negotiation.cc:407] Connection header received
0808 05:55:10.604878 (+ 1430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:10.604881 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:10.604944 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:10.605050 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:10.606625 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.607216 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.608680 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.609006 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.609132 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:10.611973 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:10.611980 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:10.611986 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:10.612022 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:10.613717 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:10.614252 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:10.614259 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:10.614264 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:10.614364 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:10.614718 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:10.614724 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:10.614729 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:10.614999 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:10.615135 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:10.615824 (+ 689us) server_negotiation.cc:299] Negotiation successful
0808 05:55:10.615986 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:55:10.617208 9769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:10.602832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:33751)
0808 05:55:10.603287 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:10.603332 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:10.604631 (+ 1299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:10.605242 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:10.605249 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:10.605747 (+ 498us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:10.606420 (+ 673us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:10.606440 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.607349 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.607351 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:10.608548 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:10.608560 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.609177 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.609181 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:10.609358 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:10.610043 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:10.610061 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:10.611795 (+ 1734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:10.613842 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:10.613846 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:10.613860 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:10.614143 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:10.614461 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:10.614463 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:10.614465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:10.614619 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:10.615153 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:10.615160 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:10.615519 (+ 359us) client_negotiation.cc:769] Sending connection context
0808 05:55:10.615736 (+ 217us) client_negotiation.cc:240] Negotiation successful
0808 05:55:10.616041 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":275,"thread_start_us":122,"threads_started":1}
I20260808 05:55:10.618728 9766 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36447
I20260808 05:55:10.619004 9766 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:10.619573 9766 heartbeater.cc:511] Master 127.2.191.126:36447 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:55:10.621488 9562 ts_manager.cc:194] Registered new tserver with Master: 96fe63e894c34b0d9829bc70894764c1 (127.2.191.65:39411)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.66@KRBTEST.COM" created.
I20260808 05:55:10.623056 9562 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:33751
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab.
Entry for principal oryx/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab.
I20260808 05:55:10.641139 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36447
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab
--principal=oryx/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:10.762627 9772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:10.762961 9772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:10.763036 9772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:10.767283 9772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:10.767397 9772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:10.767493 9772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:10.773207 9772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab
--principal=oryx/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:10.774451 9772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:10.775655 9772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:10.785790 9780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:10.785828 9782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:10.785790 9779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:10.786257 9772 server_base.cc:1034] running on GCE node
I20260808 05:55:10.786744 9772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:10.787426 9772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:10.788614 9772 hybrid_clock.cc:648] HybridClock initialized: now 1786168510788573 us; error 64 us; skew 500 ppm
Aug 08 05:55:10 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:10.792039 9772 init.cc:377] Logged in from keytab as oryx/127.2.191.66@KRBTEST.COM (short username oryx)
I20260808 05:55:10.793233 9772 webserver.cc:460] Webserver started at http://127.2.191.66:34933/ using document root <none> and password file <none>
I20260808 05:55:10.793874 9772 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:10.794040 9772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:10.794314 9772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:10.796674 9772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "8e952373d5cd410187fbdc3aaa5723fb"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "7175e0343592249dc656e69331668667"
server_key_iv: "5d109304d1b93b15f2a55c11df0c3ce9"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.797434 9772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "8e952373d5cd410187fbdc3aaa5723fb"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "7175e0343592249dc656e69331668667"
server_key_iv: "5d109304d1b93b15f2a55c11df0c3ce9"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.801798 9772 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:55:10.804557 9789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:10.806131 9772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:10.806289 9772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "8e952373d5cd410187fbdc3aaa5723fb"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "7175e0343592249dc656e69331668667"
server_key_iv: "5d109304d1b93b15f2a55c11df0c3ce9"
server_key_version: "encryptionkey@0"
I20260808 05:55:10.806424 9772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:10.823293 9772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:10.826745 9772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:10.826998 9772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:10.827689 9772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:10.828682 9772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:10.828804 9772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:10.828908 9772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:10.828987 9772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:10.839643 9772 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:40141
I20260808 05:55:10.839689 9910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:40141 every 8 connection(s)
I20260808 05:55:10.840680 9772 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:10.848978 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 9772
I20260808 05:55:10.849116 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:10.849488 2813 external_mini_cluster.cc:1428] Setting key 5b5fca1e1fb80eb7ec7cccb91b4cac4d
Aug 08 05:55:10 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:10.856980 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:10.842753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:37839 (local address 127.2.191.126:36447)
0808 05:55:10.842912 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:10.842917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:10.843919 (+ 1002us) server_negotiation.cc:407] Connection header received
0808 05:55:10.845406 (+ 1487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:10.845409 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:10.845459 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:10.845543 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:10.846823 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.847368 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.848688 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.849138 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.849272 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:10.852649 (+ 3377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:10.852652 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:10.852654 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:10.852681 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:10.854557 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:10.855112 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:10.855118 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:10.855123 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:10.855219 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:10.855606 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:10.855609 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:10.855611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:10.855836 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:10.855958 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:10.856630 (+ 672us) server_negotiation.cc:299] Negotiation successful
0808 05:55:10.856804 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:55:10.857833 9915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:10.843218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:37839)
0808 05:55:10.843753 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:10.843800 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:10.845173 (+ 1373us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:10.845703 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:10.845710 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:10.846095 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:10.846630 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:10.846645 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.847520 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.847522 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:10.848524 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:10.848535 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:10.849387 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:10.849391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:10.849596 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:10.850410 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:10.850430 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:10.852449 (+ 2019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:10.854692 (+ 2243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:10.854697 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:10.854710 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:10.854990 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:10.855321 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:10.855324 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:10.855326 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:10.855475 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:10.855958 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:10.855967 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:10.856351 (+ 384us) client_negotiation.cc:769] Sending connection context
0808 05:55:10.856560 (+ 209us) client_negotiation.cc:240] Negotiation successful
0808 05:55:10.856950 (+ 390us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":119,"threads_started":1}
I20260808 05:55:10.859091 9911 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36447
I20260808 05:55:10.859365 9911 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:10.859897 9911 heartbeater.cc:511] Master 127.2.191.126:36447 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:55:10.861115 9562 ts_manager.cc:194] Registered new tserver with Master: 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141)
I20260808 05:55:10.861806 9562 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:37839
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab.
Entry for principal oryx/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab.
I20260808 05:55:10.884541 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36447
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab
--principal=oryx/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:11.003594 9919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:11.003906 9919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:11.003957 9919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:11.008635 9919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:11.008721 9919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:11.008863 9919 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:11.014722 9919 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab
--principal=oryx/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36447
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:11.015908 9919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:11.017014 9919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:11.028112 9924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.028189 9927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.028189 9925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:11.028451 9919 server_base.cc:1034] running on GCE node
I20260808 05:55:11.029098 9919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:11.029904 9919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:11.031189 9919 hybrid_clock.cc:648] HybridClock initialized: now 1786168511031166 us; error 34 us; skew 500 ppm
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:11.034425 9919 init.cc:377] Logged in from keytab as oryx/127.2.191.67@KRBTEST.COM (short username oryx)
I20260808 05:55:11.035486 9919 webserver.cc:460] Webserver started at http://127.2.191.67:43625/ using document root <none> and password file <none>
I20260808 05:55:11.036126 9919 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:11.036226 9919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:11.036490 9919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:11.038936 9919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "4ee95ab20a744f07be295b65a58f6e27"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "c981baf4e79706b8a5d41416352672a1"
server_key_iv: "467ca2cd5c64f969de122a6d0072895b"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.039568 9919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "4ee95ab20a744f07be295b65a58f6e27"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "c981baf4e79706b8a5d41416352672a1"
server_key_iv: "467ca2cd5c64f969de122a6d0072895b"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.043849 9919 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:55:11.046815 9935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.048501 9919 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:11.048635 9919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "4ee95ab20a744f07be295b65a58f6e27"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "c981baf4e79706b8a5d41416352672a1"
server_key_iv: "467ca2cd5c64f969de122a6d0072895b"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.048835 9919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:11.063148 9919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:11.066864 9919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:11.067051 9919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:11.067644 9919 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:11.068535 9919 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:11.068599 9919 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.068645 9919 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:11.068660 9919 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.078361 9919 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:43757
I20260808 05:55:11.078506 10052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:43757 every 8 connection(s)
I20260808 05:55:11.079442 9919 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:11.082791 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 9919
I20260808 05:55:11.082937 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:11.083228 2813 external_mini_cluster.cc:1428] Setting key e3ab90decdbd2c928ffe3e3c1f0c588b
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:11.094801 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.081700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:60383 (local address 127.2.191.126:36447)
0808 05:55:11.081898 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.081902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.082778 (+ 876us) server_negotiation.cc:407] Connection header received
0808 05:55:11.084321 (+ 1543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.084328 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.084391 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.084501 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.085860 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.086404 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.087588 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.087818 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.087930 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.090748 (+ 2818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.090752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.090754 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.090781 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.092371 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.093133 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.093137 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.093138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.093235 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.093612 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.093615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.093617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.093821 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.093936 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.094494 (+ 558us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.094630 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260808 05:55:11.095799 10055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.082088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:60383)
0808 05:55:11.082597 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.082649 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.084045 (+ 1396us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.084701 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.084709 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.085164 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.085682 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.085696 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.086541 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.086545 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.087450 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.087460 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.087988 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.087992 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.088171 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.088903 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.088932 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.090531 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.092548 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.092554 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.092578 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.093008 (+ 430us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.093343 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.093346 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.093348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.093502 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.093943 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.093952 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.094228 (+ 276us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.094427 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.094795 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":122,"threads_started":1}
I20260808 05:55:11.097002 10053 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36447
I20260808 05:55:11.097343 10053 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:11.097859 10053 heartbeater.cc:511] Master 127.2.191.126:36447 requested a full tablet report, sending...
I20260808 05:55:11.099020 9561 ts_manager.cc:194] Registered new tserver with Master: 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757)
I20260808 05:55:11.099721 9561 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:60383
I20260808 05:55:11.109639 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.2.191.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.125.keytab.
Entry for principal oryx/127.2.191.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.125.keytab.
I20260808 05:55:11.141607 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.125:37423
--webserver_interface=127.2.191.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.125.keytab
--principal=oryx/127.2.191.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:36447,127.2.191.125:37423
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:11.258350 10058 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:11.258637 10058 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:11.258682 10058 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:11.262791 10058 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:11.262854 10058 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:11.262874 10058 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:11.262892 10058 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:11.262907 10058 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:11.268486 10058 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:36447,127.2.191.125:37423
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.125.keytab
--principal=oryx/127.2.191.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.125:37423
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.191.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10058
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
W20260808 05:55:11.268775 10058 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.2.191.126:36447,127.2.191.125:37423'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 05:55:11.269718 10058 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:11.270788 10058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:11.279953 10064 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:11.280082 10058 server_base.cc:1034] running on GCE node
W20260808 05:55:11.280035 10067 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.280287 10065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:11.280980 10058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:11.282213 10058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:11.283404 10058 hybrid_clock.cc:648] HybridClock initialized: now 1786168511283374 us; error 51 us; skew 500 ppm
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:11.286403 10058 init.cc:377] Logged in from keytab as oryx/127.2.191.125@KRBTEST.COM (short username oryx)
I20260808 05:55:11.287374 10058 webserver.cc:460] Webserver started at http://127.2.191.125:46239/ using document root <none> and password file <none>
I20260808 05:55:11.287951 10058 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:11.288043 10058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:11.288307 10058 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:11.290501 10058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data/instance:
uuid: "3ba5eece9c114c62b0e5f637884b95e8"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "7a734a3db7ea72a6d56ba6fb1f5a88f5"
server_key_iv: "089e4bb257ffa47a2dfa5fcca828209b"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.291102 10058 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal/instance:
uuid: "3ba5eece9c114c62b0e5f637884b95e8"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "7a734a3db7ea72a6d56ba6fb1f5a88f5"
server_key_iv: "089e4bb257ffa47a2dfa5fcca828209b"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.295290 10058 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 05:55:11.297912 10074 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.299466 10058 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:55:11.299628 10058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
uuid: "3ba5eece9c114c62b0e5f637884b95e8"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "7a734a3db7ea72a6d56ba6fb1f5a88f5"
server_key_iv: "089e4bb257ffa47a2dfa5fcca828209b"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.299759 10058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:11.321605 10058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:11.325582 10058 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:11.325793 10058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:11.334482 10058 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.125:37423
I20260808 05:55:11.334512 10126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.125:37423 every 8 connection(s)
I20260808 05:55:11.335542 10058 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
I20260808 05:55:11.339180 10127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:11.339500 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 10058
I20260808 05:55:11.344460 10127 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.191.125@KRBTEST.COM
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.125@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:11.357081 10130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.341256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53762 (local address 127.2.191.125:37423)
0808 05:55:11.341786 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.341806 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.341854 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:55:11.342607 (+ 753us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.342626 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.342957 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.343252 (+ 295us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.344290 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.345490 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.346629 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.347311 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.347522 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.350665 (+ 3143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.350671 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.350681 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.350711 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.352817 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.353488 (+ 671us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.353494 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.353501 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.353643 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.354361 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.354369 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.354372 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.354890 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.355210 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.355568 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.355907 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":167,"threads_started":1}
I20260808 05:55:11.357750 10131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.346692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:46208)
0808 05:55:11.347093 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.347137 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.347292 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.347651 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.347656 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.348045 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.348201 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.348207 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.349466 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.349469 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.350373 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.350384 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.351120 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.351123 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.351254 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.351841 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.351861 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.353724 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.355986 (+ 2262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.355993 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.355999 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.356277 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.356559 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.356562 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.356564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.356655 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.357189 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.357194 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.357312 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.357462 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.357630 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":137,"threads_started":1}
I20260808 05:55:11.357851 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.346739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46208 (local address 127.2.191.126:36447)
0808 05:55:11.346885 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.346892 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.347229 (+ 337us) server_negotiation.cc:407] Connection header received
0808 05:55:11.347395 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.347399 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.347483 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.347578 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.348343 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.349300 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.350596 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.350828 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.351107 (+ 279us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.353906 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.353910 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.353914 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.353952 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.355882 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.356381 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.356384 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.356386 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.356467 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.356829 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.356832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.356833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.357063 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.357184 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.357547 (+ 363us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.357684 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:55:11.359884 10127 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.125@KRBTEST.COM for oryx/127.2.191.125@KRBTEST.COM
I20260808 05:55:11.368836 10131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.360452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.0.0.1:53774)
0808 05:55:11.360629 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.360647 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.360774 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.361036 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.361039 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.361243 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.361784 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.361793 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.362622 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.362625 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.363175 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.363182 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.363669 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.363673 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.363772 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.364227 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.364239 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.365573 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.367180 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.367187 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.367189 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.367396 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.367691 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.367697 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.367699 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.367784 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.368227 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.368230 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.368325 (+ 95us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.368452 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.368610 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:55:11.368836 10130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.360535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53774 (local address 127.2.191.125:37423)
0808 05:55:11.360640 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.360646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.360694 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:55:11.360885 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.360889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.360937 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.361026 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.361912 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.362484 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.363302 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.363548 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.363670 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.365737 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.365741 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.365744 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.365775 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.367037 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.367502 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.367508 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.367510 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.367591 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.367889 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.367893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.367895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.368075 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.368227 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.368499 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.368664 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":48}
I20260808 05:55:11.372444 10127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Bootstrap starting.
I20260808 05:55:11.374928 10127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:11.375667 10127 log.cc:824] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:11.377928 10127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: No bootstrap required, opened a new log
I20260808 05:55:11.381188 10127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } }
I20260808 05:55:11.381419 10127 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:11.381465 10127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ba5eece9c114c62b0e5f637884b95e8, State: Initialized, Role: FOLLOWER
I20260808 05:55:11.381870 10127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } }
I20260808 05:55:11.382341 10133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } } }
I20260808 05:55:11.382501 10133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:55:11.383164 10127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 05:55:11.387995 10146 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:55:11.388121 10146 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:55:11.391260 10058 master_runner.cc:428] Detected that this master 3ba5eece9c114c62b0e5f637884b95e8 is joining an existing cluster
I20260808 05:55:11.391350 10058 master_runner.cc:432] Initiating AddMaster RPC to add 127.2.191.125:37423
I20260808 05:55:11.403393 10154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.394030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.0.0.1:53776)
0808 05:55:11.394389 (+ 359us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.394409 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.394514 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.394860 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.394862 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.395068 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.395196 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.395201 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.395896 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.395899 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.396722 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.396777 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.397474 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.397476 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.397533 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.398273 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.398292 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.398705 (+ 413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.400617 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.400621 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.400623 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.401934 (+ 1311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.402270 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.402275 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.402277 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.402358 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.402748 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.402751 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.402836 (+ 85us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.402950 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.403173 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":136,"threads_started":1}
I20260808 05:55:11.403442 10130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.393808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53776 (local address 127.2.191.125:37423)
0808 05:55:11.393932 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.393937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.394481 (+ 544us) server_negotiation.cc:407] Connection header received
0808 05:55:11.394631 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.394634 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.394676 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.394725 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.395299 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.395780 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.396882 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.397250 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.397329 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.398840 (+ 1511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.398843 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.398846 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.398875 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.400436 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.402081 (+ 1645us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.402084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.402106 (+ 22us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.402191 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.402457 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.402462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.402464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.402650 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.402761 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.403064 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.403269 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":50}
I20260808 05:55:11.403838 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.393726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46220 (local address 127.2.191.126:36447)
0808 05:55:11.393876 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.393881 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.394192 (+ 311us) server_negotiation.cc:407] Connection header received
0808 05:55:11.394415 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.394419 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.394484 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.394588 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.395168 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.396079 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.397367 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.397748 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.397868 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.399382 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.399386 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.399390 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.399419 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.401455 (+ 2036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.401987 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.401990 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.401992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.402117 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.402809 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.402812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.402814 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.403032 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.403179 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.403522 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.403673 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 05:55:11.404341 10153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.393668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:46220)
0808 05:55:11.394086 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.394106 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.394240 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.394610 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.394616 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.394860 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.394997 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.395008 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.396286 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.396289 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.397242 (+ 953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.397250 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.397896 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.397902 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.398029 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.398476 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.398494 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.399057 (+ 563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.401571 (+ 2514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.401574 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.401575 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.401875 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.402229 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.402232 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.402235 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.402340 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.403224 (+ 884us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.403227 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.403324 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.403987 (+ 663us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.404128 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":338,"mutex_wait_us":37,"thread_start_us":92,"threads_started":1}
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.126@KRBTEST.COM for oryx/127.2.191.125@KRBTEST.COM
I20260808 05:55:11.419138 10130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.409303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53778 (local address 127.2.191.125:37423)
0808 05:55:11.409434 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.409439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.409802 (+ 363us) server_negotiation.cc:407] Connection header received
0808 05:55:11.409993 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.409997 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.410053 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.410179 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.410975 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.411616 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.412494 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.412778 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.412890 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.415793 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.415796 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.415799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.415829 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.417355 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.417825 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.417830 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.417831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.417912 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.418198 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.418203 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.418205 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.418410 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.418521 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.418852 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.418969 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:55:11.419175 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.409256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.0.0.1:53778)
0808 05:55:11.409661 (+ 405us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.409714 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.409852 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.410256 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.410263 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.410716 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.410872 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.410880 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.411733 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.411737 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.412371 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.412380 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.412904 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.412908 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.413021 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.413570 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.413589 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.415654 (+ 2065us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.417469 (+ 1815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.417480 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.417486 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.417722 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.418006 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.418011 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.418013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.418102 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.418521 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.418530 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.418655 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.418801 (+ 146us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.418998 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":133,"threads_started":1}
I20260808 05:55:11.420658 9561 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.2.191.125:37423: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8"
member_type: NON_VOTER
last_known_addr {
host: "127.2.191.125"
port: 37423
}
attrs {
promote: true
}
}
dest_uuid: "eba2996fd09d42aa8bd020146491a69d"
cas_config_opid_index: -1
I20260808 05:55:11.421448 9561 consensus_queue.cc:237] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } }
WARNING: no policy specified for oryx/127.2.191.124@KRBTEST.COM; defaulting to no policy
I20260808 05:55:11.423797 10160 raft_consensus.cc:2932] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3ba5eece9c114c62b0e5f637884b95e8 (127.2.191.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } }
I20260808 05:55:11.424597 10101 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 0 FOLLOWER]: Advancing to term 1
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.124@KRBTEST.COM" created.
I20260808 05:55:11.426528 10101 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Refusing update from remote peer eba2996fd09d42aa8bd020146491a69d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 05:55:11.427093 10160 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.2.191.125:37423
I20260808 05:55:11.427574 10058 master.cc:537] Master@127.2.191.125:37423 shutting down...
I20260808 05:55:11.428509 10160 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } }
I20260808 05:55:11.428622 10160 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:11.428871 10160 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 05:55:11.431362 9548 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 05:55:11.433112 9548 consensus_peers.cc:487] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d -> Peer 3ba5eece9c114c62b0e5f637884b95e8 (127.2.191.125:37423): Couldn't send request to peer 3ba5eece9c114c62b0e5f637884b95e8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 05:55:11.433637 10058 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:11.433945 10058 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:11.434063 10058 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: stopping tablet replica
I20260808 05:55:11.439393 10058 master.cc:552] Master@127.2.191.125:37423 shutdown complete.
I20260808 05:55:11.439453 10058 master_runner.cc:305] Clearing existing system tablet
I20260808 05:55:11.439725 10058 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:11.439790 10058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:11.441349 10058 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:55:11.442382 10167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.442606 10058 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:11.442731 10058 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:11.442782 10058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
uuid: "3ba5eece9c114c62b0e5f637884b95e8"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "7a734a3db7ea72a6d56ba6fb1f5a88f5"
server_key_iv: "089e4bb257ffa47a2dfa5fcca828209b"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.444898 10058 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:11.447916 10058 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 05:55:11.448009 10058 log.cc:1196] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 05:55:11.448307 10058 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Deleting consensus metadata
I20260808 05:55:11.448519 10058 master_runner.cc:315] Copying system tablet from 127.2.191.126:36447
I20260808 05:55:11.450024 10058 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: tablet copy: Beginning tablet copy session from remote peer at address 127.2.191.126:36447
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.124.keytab.
Entry for principal oryx/127.2.191.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.124.keytab.
I20260808 05:55:11.453001 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.124:38871
--webserver_interface=127.2.191.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.124.keytab
--principal=oryx/127.2.191.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:36447,127.2.191.125:37423,127.2.191.124:38871
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:55:11.461673 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.450717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46236 (local address 127.2.191.126:36447)
0808 05:55:11.450867 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.450871 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.450990 (+ 119us) server_negotiation.cc:407] Connection header received
0808 05:55:11.451214 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.451216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.451261 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.451331 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.451939 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.452911 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.454269 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.454690 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.454808 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.457056 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.457063 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.457069 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.457106 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.459300 (+ 2194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.459905 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.459912 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.459917 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.460028 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.460388 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.460392 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.460396 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.460686 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.460795 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.461266 (+ 471us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.461423 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:55:11.462664 10174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.450566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:46236)
0808 05:55:11.450890 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.450909 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.451093 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.451384 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.451388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.451632 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.451764 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.451772 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.453049 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.453053 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.454113 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.454128 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.454963 (+ 835us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.454967 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.455066 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.456294 (+ 1228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.456311 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.456882 (+ 571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.459449 (+ 2567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.459455 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.459458 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.459769 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.460160 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.460166 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.460169 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.460272 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.460884 (+ 612us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.460890 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.461039 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.462186 (+ 1147us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.462381 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":118,"threads_started":1}
I20260808 05:55:11.463722 9583 tablet_copy_service.cc:140] P eba2996fd09d42aa8bd020146491a69d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3ba5eece9c114c62b0e5f637884b95e8 ({username='oryx', principal='oryx/127.2.191.125@KRBTEST.COM'} at 127.0.0.1:46236)
I20260808 05:55:11.463938 9583 tablet_copy_service.cc:161] P eba2996fd09d42aa8bd020146491a69d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3ba5eece9c114c62b0e5f637884b95e8 at {username='oryx', principal='oryx/127.2.191.125@KRBTEST.COM'} at 127.0.0.1:46236: session id = 3ba5eece9c114c62b0e5f637884b95e8-00000000000000000000000000000000
I20260808 05:55:11.466097 9583 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 05:55:11.468005 10058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 05:55:11.470455 10058 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: tablet copy: Starting download of 0 data blocks...
I20260808 05:55:11.470654 10058 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: tablet copy: Starting download of 1 WAL segments...
I20260808 05:55:11.472640 10058 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 05:55:11.474587 9583 tablet_copy_service.cc:342] P eba2996fd09d42aa8bd020146491a69d: Request end of tablet copy session 3ba5eece9c114c62b0e5f637884b95e8-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.2.191.125@KRBTEST.COM'} at 127.0.0.1:46236
I20260808 05:55:11.474717 9583 tablet_copy_service.cc:433] P eba2996fd09d42aa8bd020146491a69d: ending tablet copy session 3ba5eece9c114c62b0e5f637884b95e8-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3ba5eece9c114c62b0e5f637884b95e8
I20260808 05:55:11.483664 10058 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:11.485522 10176 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.485601 10179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:11.486091 10058 server_base.cc:1034] running on GCE node
W20260808 05:55:11.486316 10177 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:11.486544 10058 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:11.486833 10058 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:11.487996 10058 hybrid_clock.cc:648] HybridClock initialized: now 1786168511487970 us; error 45 us; skew 500 ppm
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:11.489804 10058 init.cc:377] Logged in from keytab as oryx/127.2.191.125@KRBTEST.COM (short username oryx)
I20260808 05:55:11.490299 10058 webserver.cc:460] Webserver started at http://127.2.191.125:39057/ using document root <none> and password file <none>
I20260808 05:55:11.490509 10058 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:11.490556 10058 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:11.492229 10058 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:55:11.493403 10186 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.493697 10058 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:55:11.493781 10058 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
uuid: "3ba5eece9c114c62b0e5f637884b95e8"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "7a734a3db7ea72a6d56ba6fb1f5a88f5"
server_key_iv: "089e4bb257ffa47a2dfa5fcca828209b"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.493872 10058 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:11.518579 10058 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:11.520931 10058 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:11.526681 10058 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.125:37423
I20260808 05:55:11.526701 10243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.125:37423 every 8 connection(s)
I20260808 05:55:11.527356 10058 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
I20260808 05:55:11.529484 10245 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:55:11.530668 10245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Bootstrap starting.
I20260808 05:55:11.541751 10245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:55:11.542114 10245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: Bootstrap complete.
I20260808 05:55:11.542758 10245 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } }
I20260808 05:55:11.542900 10245 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3ba5eece9c114c62b0e5f637884b95e8, State: Initialized, Role: LEARNER
I20260808 05:55:11.543107 10245 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } }
I20260808 05:55:11.543464 10248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } }
I20260808 05:55:11.543671 10248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: This master's current role is: LEARNER
I20260808 05:55:11.543797 10245 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:11.547631 10259 catalog_manager.cc:1259] Loaded cluster ID: 6403146fce1047268fe96d5cdc56e645
I20260808 05:55:11.547775 10259 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: loading cluster ID for follower catalog manager: success
I20260808 05:55:11.550531 10259 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: acquiring CA information for follower catalog manager: success
I20260808 05:55:11.552258 10259 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 05:55:11.595399 10175 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:11.595809 10175 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:11.595924 10175 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:11.601140 10175 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:11.601230 10175 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:11.601263 10175 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:11.601290 10175 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:11.601315 10175 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:11.608397 10175 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:36447,127.2.191.125:37423,127.2.191.124:38871
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.124.keytab
--principal=oryx/127.2.191.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.124:38871
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.191.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10175
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:11.609622 10175 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:11.610841 10175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:11.620028 10264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.620044 10265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.620028 10267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:11.620285 10175 server_base.cc:1034] running on GCE node
I20260808 05:55:11.621122 10175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:11.622354 10175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:11.623526 10175 hybrid_clock.cc:648] HybridClock initialized: now 1786168511623498 us; error 42 us; skew 500 ppm
I20260808 05:55:11.625808 9766 heartbeater.cc:503] Master 127.2.191.126:36447 was elected leader, sending a full tablet report...
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:11.626686 10175 init.cc:377] Logged in from keytab as oryx/127.2.191.124@KRBTEST.COM (short username oryx)
I20260808 05:55:11.627794 10175 webserver.cc:460] Webserver started at http://127.2.191.124:35739/ using document root <none> and password file <none>
I20260808 05:55:11.628387 10175 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:11.628485 10175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:11.628708 10175 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:11.630899 10175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data/instance:
uuid: "393e63224dd444b2a71eea7176a3b754"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "0b8c9a68fff633bb11700f076263db55"
server_key_iv: "4e72f67b2d89b8e568c53cad0ae15161"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.631512 10175 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal/instance:
uuid: "393e63224dd444b2a71eea7176a3b754"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "0b8c9a68fff633bb11700f076263db55"
server_key_iv: "4e72f67b2d89b8e568c53cad0ae15161"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.635599 10175 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 05:55:11.638484 10274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.639736 10175 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:55:11.639889 10175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
uuid: "393e63224dd444b2a71eea7176a3b754"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "0b8c9a68fff633bb11700f076263db55"
server_key_iv: "4e72f67b2d89b8e568c53cad0ae15161"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.640021 10175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:11.662909 10175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:11.666230 10175 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:11.666451 10175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:11.674836 10175 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.124:38871
I20260808 05:55:11.675227 10336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.124:38871 every 8 connection(s)
I20260808 05:55:11.676167 10175 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
I20260808 05:55:11.679323 10337 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:11.682816 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 10175
I20260808 05:55:11.683758 10337 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.191.124@KRBTEST.COM
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.124@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:11.697414 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.687488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46244 (local address 127.2.191.126:36447)
0808 05:55:11.687636 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.687640 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.687764 (+ 124us) server_negotiation.cc:407] Connection header received
0808 05:55:11.687894 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.687896 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.687937 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.688007 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.688935 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.689447 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.690413 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.690728 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.690955 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.693811 (+ 2856us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.693814 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.693816 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.693842 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.695296 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.695812 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.695815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.695818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.695905 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.696303 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.696307 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.696309 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.696503 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.696617 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.697078 (+ 461us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.697218 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 05:55:11.698244 10341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.686649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:46244)
0808 05:55:11.687623 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.687676 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.687806 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.688090 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.688096 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.688547 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.688773 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.688787 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.689588 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.689591 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.690276 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.690285 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.690995 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.690999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.691119 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.691607 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.691623 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.693644 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.695419 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.695431 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.695442 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.695692 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.695999 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.696004 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.696006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.696200 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.696622 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.696631 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.696832 (+ 201us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.697033 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.697501 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"mutex_wait_us":159,"thread_start_us":305,"threads_started":1}
I20260808 05:55:11.698266 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.684388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44012 (local address 127.2.191.124:38871)
0808 05:55:11.684896 (+ 508us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.684914 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.684951 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:55:11.685841 (+ 890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.685862 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.686256 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.686626 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.687520 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.689005 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.689872 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.690337 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.690519 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.693361 (+ 2842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.693367 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.693378 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.693400 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.695349 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.695849 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.695855 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.695856 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.695969 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.696266 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.696270 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.696272 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.696650 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.696896 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.697079 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.697364 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":354,"thread_start_us":144,"threads_started":1}
I20260808 05:55:11.699532 10337 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.124@KRBTEST.COM for oryx/127.2.191.125@KRBTEST.COM
I20260808 05:55:11.708038 10341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.700060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.0.0.1:53782)
0808 05:55:11.700251 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.700266 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.700348 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.701010 (+ 662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.701013 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.701151 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.701254 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.701259 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.702115 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.702117 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.702662 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.702669 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.703076 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.703078 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.703153 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.703565 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.703576 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.704958 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.706759 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.706761 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.706763 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.706945 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.707229 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.707231 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.707232 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.707303 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.707644 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.707645 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.707723 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.707803 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.707910 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260808 05:55:11.708127 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.700224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53782 (local address 127.2.191.125:37423)
0808 05:55:11.700789 (+ 565us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.700794 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.700808 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:11.700856 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.700858 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.700898 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.700975 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.701362 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.702019 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.702763 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.702981 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.703059 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.705099 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.705102 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.705104 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.705129 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.706661 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.707028 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.707031 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.707032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.707149 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.707379 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.707381 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.707382 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.707559 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.707636 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.707860 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.707963 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":110,"threads_started":1}
I20260808 05:55:11.708946 10337 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.124@KRBTEST.COM for oryx/127.2.191.124@KRBTEST.COM
I20260808 05:55:11.716797 10341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.709448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:38871 (local address 127.0.0.1:44020)
0808 05:55:11.709567 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.709584 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.709678 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.709911 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.709913 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.710041 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.710121 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.710126 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.710939 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.710941 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.711445 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.711453 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.711923 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.711926 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.711984 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.712395 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.712405 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.713659 (+ 1254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.715310 (+ 1651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.715313 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.715315 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.715504 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.715779 (+ 275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.715785 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.715787 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.715867 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.716228 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.716231 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.716317 (+ 86us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.716423 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.716564 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 05:55:11.716797 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.709511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44020 (local address 127.2.191.124:38871)
0808 05:55:11.709622 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.709626 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.709644 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:55:11.709776 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.709778 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.709812 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.709889 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.710238 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.710839 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.711548 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.711826 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.711906 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.713796 (+ 1890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.713798 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.713800 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.713818 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.715168 (+ 1350us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.715619 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.715622 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.715627 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.715694 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.715956 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.715960 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.715962 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.716135 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.716239 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.716469 (+ 230us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.716631 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":55,"server-negotiator.queue_time_us":41}
I20260808 05:55:11.721206 10337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Bootstrap starting.
I20260808 05:55:11.723636 10337 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:11.724434 10337 log.cc:824] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:11.726625 10337 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: No bootstrap required, opened a new log
I20260808 05:55:11.730006 10337 raft_consensus.cc:348] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } }
I20260808 05:55:11.730259 10337 raft_consensus.cc:374] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:11.730297 10337 raft_consensus.cc:729] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 393e63224dd444b2a71eea7176a3b754, State: Initialized, Role: FOLLOWER
I20260808 05:55:11.730729 10337 consensus_queue.cc:260] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } }
I20260808 05:55:11.731271 10344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } } }
I20260808 05:55:11.731415 10344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:55:11.732024 10337 sys_catalog.cc:564] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 05:55:11.738344 10355 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:55:11.738444 10355 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:55:11.742367 10175 master_runner.cc:428] Detected that this master 393e63224dd444b2a71eea7176a3b754 is joining an existing cluster
I20260808 05:55:11.742444 10175 master_runner.cc:432] Initiating AddMaster RPC to add 127.2.191.124:38871
I20260808 05:55:11.751929 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 9629
I20260808 05:55:11.756187 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.745295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53788 (local address 127.2.191.125:37423)
0808 05:55:11.745434 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.745439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.746539 (+ 1100us) server_negotiation.cc:407] Connection header received
0808 05:55:11.746740 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.746743 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.746799 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.746889 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.747637 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.748418 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.750529 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.750923 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.751002 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.752343 (+ 1341us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.752350 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.752355 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.752385 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.754422 (+ 2037us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.754905 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.754910 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.754912 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.755009 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.755309 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.755314 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.755316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.755520 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.755638 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.755901 (+ 263us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.756029 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:55:11.756199 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.745580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.0.0.1:53788)
0808 05:55:11.746456 (+ 876us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.746469 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.746609 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.746903 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.746905 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.747206 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.747448 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.747473 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.748540 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.748542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.750400 (+ 1858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.750406 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.751166 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.751170 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.751277 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.751724 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.751738 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.752198 (+ 460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.754592 (+ 2394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.754595 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.754597 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.754800 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.755112 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.755115 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.755117 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.755214 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.755632 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.755636 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.755738 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.755847 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.756002 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":814,"mutex_wait_us":137,"spinlock_wait_cycles":4864,"thread_start_us":154,"threads_started":1}
I20260808 05:55:11.767155 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:39411
--local_ip_for_outbound_sockets=127.2.191.65
--tserver_master_addrs=127.2.191.126:36447
--webserver_port=46869
--webserver_interface=127.2.191.65
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab
--principal=oryx/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423,127.2.191.124:38871 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:55:11.774562 10364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.745258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:46252)
0808 05:55:11.746011 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.746028 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.746183 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.746568 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.746571 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.746910 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.747147 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.747157 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.748336 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.748340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.749689 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.749701 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.750503 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.750507 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.750655 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.769498 (+ 18843us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.769520 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.770237 (+ 717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.772673 (+ 2436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.772677 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.772679 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.773012 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.773362 (+ 350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.773365 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.773367 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.773455 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.773953 (+ 498us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.773956 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.774060 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.774187 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.774348 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"spinlock_wait_cycles":2944,"thread_start_us":114,"threads_started":1}
I20260808 05:55:11.775502 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.745782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.2.191.126:36447)
0808 05:55:11.745909 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.745913 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.746153 (+ 240us) server_negotiation.cc:407] Connection header received
0808 05:55:11.746283 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.746286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.746344 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.746430 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.747304 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.748178 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.749849 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.750192 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.750283 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.770459 (+ 20176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.770464 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.770469 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.770509 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.772507 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.773151 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.773155 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.773157 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.773253 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.773563 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.773567 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.773569 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.773814 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.773908 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.775209 (+ 1301us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.775344 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:55:11.775677 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.745685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44024 (local address 127.2.191.124:38871)
0808 05:55:11.745799 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.745805 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.746170 (+ 365us) server_negotiation.cc:407] Connection header received
0808 05:55:11.746322 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.746326 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.746367 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.746436 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.747658 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.748406 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.749873 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.750193 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.750263 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.770159 (+ 19896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.770165 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.770168 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.770201 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.773443 (+ 3242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.774015 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.774021 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.774024 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.774129 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.774468 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.774472 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.774475 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.774723 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.774804 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.775282 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.775422 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":37,"spinlock_wait_cycles":896}
I20260808 05:55:11.776352 10361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.745308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:38871 (local address 127.0.0.1:44024)
0808 05:55:11.746061 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.746076 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.746215 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.746605 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.746607 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.747206 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.747534 (+ 328us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.747545 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.748538 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.748540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.749751 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.749762 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.750444 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.750457 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.750562 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.751199 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.751215 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.769901 (+ 18686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.773586 (+ 3685us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.773592 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.773596 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.773883 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.774245 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.774249 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.774253 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.774360 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.774877 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.774881 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.775078 (+ 197us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.775894 (+ 816us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.776082 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":678,"mutex_wait_us":133,"thread_start_us":125,"threads_started":1}
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168510, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.126@KRBTEST.COM for oryx/127.2.191.124@KRBTEST.COM
I20260808 05:55:11.791811 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.780517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:38871 (local address 127.0.0.1:44034)
0808 05:55:11.780656 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.780672 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.780804 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.781119 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.781125 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.781408 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.781561 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.781573 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.782724 (+ 1151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.782729 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.783697 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.783709 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.784345 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.784350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.784457 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.785019 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.785035 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.786716 (+ 1681us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.789907 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.789911 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.789913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.790334 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.790674 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.790678 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.790680 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.790779 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.791231 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.791234 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.791345 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.791456 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.791623 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 05:55:11.791815 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.780571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44034 (local address 127.2.191.124:38871)
0808 05:55:11.780721 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.780770 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.780784 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:11.780926 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.780929 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.780982 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.781069 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.781698 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.782580 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.783849 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.784212 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.784318 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.786880 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.786884 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.786887 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.786915 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.789756 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.790458 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.790462 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.790464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.790564 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.790878 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.790881 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.790883 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.791117 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.791228 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.791528 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.791656 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 05:55:11.793517 9561 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.2.191.124:38871: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "393e63224dd444b2a71eea7176a3b754"
member_type: NON_VOTER
last_known_addr {
host: "127.2.191.124"
port: 38871
}
attrs {
promote: true
}
}
dest_uuid: "eba2996fd09d42aa8bd020146491a69d"
cas_config_opid_index: 5
I20260808 05:55:11.794358 9561 consensus_queue.cc:237] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } }
I20260808 05:55:11.795465 10161 raft_consensus.cc:2932] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 393e63224dd444b2a71eea7176a3b754 (127.2.191.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.796195 10306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:11.797058 10161 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.2.191.124:38871
I20260808 05:55:11.797247 10161 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.797338 10161 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:11.797696 10306 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Refusing update from remote peer eba2996fd09d42aa8bd020146491a69d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 05:55:11.798826 10160 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:11.799942 10175 master.cc:537] Master@127.2.191.124:38871 shutting down...
W20260808 05:55:11.803310 9546 consensus_peers.cc:487] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d -> Peer 393e63224dd444b2a71eea7176a3b754 (127.2.191.124:38871): Couldn't send request to peer 393e63224dd444b2a71eea7176a3b754. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 05:55:11.805258 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.797958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53802 (local address 127.2.191.125:37423)
0808 05:55:11.798091 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.798096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.800316 (+ 2220us) server_negotiation.cc:407] Connection header received
0808 05:55:11.800518 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.800522 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.800590 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.800660 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:11.801110 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.801895 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.803597 (+ 1702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.804291 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.804373 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.804531 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.805015 (+ 484us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.805120 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:55:11.805860 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.797723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.0.0.1:53802)
0808 05:55:11.800242 (+ 2519us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.800258 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.800397 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.800858 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.800861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.800878 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:11.800974 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.800979 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.802046 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.802049 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.803322 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.803334 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.804634 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.804637 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.804847 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.804896 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.805643 (+ 747us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.805739 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2439}
I20260808 05:55:11.806586 10217 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 LEARNER]: Refusing update from remote peer eba2996fd09d42aa8bd020146491a69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 05:55:11.807062 10160 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 05:55:11.809458 10217 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 393e63224dd444b2a71eea7176a3b754 (127.2.191.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.811456 10248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eba2996fd09d42aa8bd020146491a69d. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.811568 10248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: This master's current role is: LEARNER
I20260808 05:55:11.811640 10248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: NON_VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: true } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.811702 10248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: This master's current role is: LEARNER
I20260808 05:55:11.815979 10175 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:11.816318 10175 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:11.816429 10175 tablet_replica.cc:330] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: stopping tablet replica
I20260808 05:55:11.816797 10160 raft_consensus.cc:1050] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: attempting to promote NON_VOTER 3ba5eece9c114c62b0e5f637884b95e8 to VOTER
I20260808 05:55:11.817308 10160 consensus_queue.cc:237] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } }
W20260808 05:55:11.819306 9546 consensus_peers.cc:487] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d -> Peer 393e63224dd444b2a71eea7176a3b754 (127.2.191.124:38871): Couldn't send request to peer 393e63224dd444b2a71eea7176a3b754. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 05:55:11.820391 10217 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 LEARNER]: Refusing update from remote peer eba2996fd09d42aa8bd020146491a69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 05:55:11.820919 10161 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 05:55:11.824005 10175 master.cc:552] Master@127.2.191.124:38871 shutdown complete.
I20260808 05:55:11.824059 10175 master_runner.cc:305] Clearing existing system tablet
I20260808 05:55:11.824350 10175 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:11.824400 10175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:11.825070 10216 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3ba5eece9c114c62b0e5f637884b95e8 (127.2.191.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.825901 10175 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:11.826769 10369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.826918 10367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.826983 10175 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:11.827069 10367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:55:11.827104 10175 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:11.827137 10175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
uuid: "393e63224dd444b2a71eea7176a3b754"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "0b8c9a68fff633bb11700f076263db55"
server_key_iv: "4e72f67b2d89b8e568c53cad0ae15161"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.824275 10161 raft_consensus.cc:2932] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3ba5eece9c114c62b0e5f637884b95e8 (127.2.191.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.829469 10175 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:11.829546 10159 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.829675 10159 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:11.829922 10161 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.830004 10161 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:11.832576 10175 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 05:55:11.832842 10175 log.cc:1196] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 05:55:11.833202 10175 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Deleting consensus metadata
I20260808 05:55:11.833529 10175 master_runner.cc:315] Copying system tablet from 127.2.191.126:36447
I20260808 05:55:11.834894 10175 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: tablet copy: Beginning tablet copy session from remote peer at address 127.2.191.126:36447
I20260808 05:55:11.846285 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.835652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46254 (local address 127.2.191.126:36447)
0808 05:55:11.835790 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:11.835795 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:11.837026 (+ 1231us) server_negotiation.cc:407] Connection header received
0808 05:55:11.837179 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:11.837183 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:11.837244 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:11.837364 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:11.838045 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.838915 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.840100 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.840428 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.840518 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.842183 (+ 1665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:11.842187 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:11.842190 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:11.842218 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:11.844067 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.844785 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.844789 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.844791 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.844884 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:11.845219 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:11.845223 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:11.845225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:11.845514 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:11.845642 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:11.845992 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 05:55:11.846127 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:55:11.846287 10377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:11.835633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:46254)
0808 05:55:11.836902 (+ 1269us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:11.836919 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:11.837072 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:11.837515 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:11.837519 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:11.837759 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:11.837884 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.837892 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.839035 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.839038 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.839946 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:11.839959 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:11.840712 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:11.840715 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:11.840884 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:11.841553 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:11.841569 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:11.842014 (+ 445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:11.844228 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.844231 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.844233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.844546 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.845008 (+ 462us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:11.845011 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:11.845013 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:11.845106 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:11.845649 (+ 543us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:11.845652 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:11.845765 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 05:55:11.845918 (+ 153us) client_negotiation.cc:240] Negotiation successful
0808 05:55:11.846074 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1190,"thread_start_us":101,"threads_started":1}
I20260808 05:55:11.847251 9583 tablet_copy_service.cc:140] P eba2996fd09d42aa8bd020146491a69d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 393e63224dd444b2a71eea7176a3b754 ({username='oryx', principal='oryx/127.2.191.124@KRBTEST.COM'} at 127.0.0.1:46254)
I20260808 05:55:11.847362 9583 tablet_copy_service.cc:161] P eba2996fd09d42aa8bd020146491a69d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 393e63224dd444b2a71eea7176a3b754 at {username='oryx', principal='oryx/127.2.191.124@KRBTEST.COM'} at 127.0.0.1:46254: session id = 393e63224dd444b2a71eea7176a3b754-00000000000000000000000000000000
I20260808 05:55:11.848486 9583 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 05:55:11.849934 10175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 05:55:11.852429 10175 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: tablet copy: Starting download of 0 data blocks...
I20260808 05:55:11.853061 10175 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: tablet copy: Starting download of 1 WAL segments...
I20260808 05:55:11.855083 10175 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 05:55:11.857196 9583 tablet_copy_service.cc:342] P eba2996fd09d42aa8bd020146491a69d: Request end of tablet copy session 393e63224dd444b2a71eea7176a3b754-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.2.191.124@KRBTEST.COM'} at 127.0.0.1:46254
I20260808 05:55:11.857291 9583 tablet_copy_service.cc:433] P eba2996fd09d42aa8bd020146491a69d: ending tablet copy session 393e63224dd444b2a71eea7176a3b754-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 393e63224dd444b2a71eea7176a3b754
I20260808 05:55:11.864537 9911 heartbeater.cc:503] Master 127.2.191.126:36447 was elected leader, sending a full tablet report...
I20260808 05:55:11.867671 10175 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:11.869665 10378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.869874 10382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.870095 10380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:11.870227 10175 server_base.cc:1034] running on GCE node
I20260808 05:55:11.870407 10175 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:11.870714 10175 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:11.871865 10175 hybrid_clock.cc:648] HybridClock initialized: now 1786168511871850 us; error 30 us; skew 500 ppm
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:11.873626 10175 init.cc:377] Logged in from keytab as oryx/127.2.191.124@KRBTEST.COM (short username oryx)
I20260808 05:55:11.874166 10175 webserver.cc:460] Webserver started at http://127.2.191.124:45515/ using document root <none> and password file <none>
I20260808 05:55:11.874361 10175 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:11.874418 10175 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:11.875988 10175 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:55:11.877197 10389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.877519 10175 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:11.877610 10175 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
uuid: "393e63224dd444b2a71eea7176a3b754"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "0b8c9a68fff633bb11700f076263db55"
server_key_iv: "4e72f67b2d89b8e568c53cad0ae15161"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.877707 10175 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:11.884029 10175 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:11.886404 10175 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:11.891763 10175 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.124:38871
I20260808 05:55:11.892397 10175 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
I20260808 05:55:11.892828 10448 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.124:38871 every 8 connection(s)
I20260808 05:55:11.894845 10449 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:55:11.896200 10449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Bootstrap starting.
I20260808 05:55:11.910066 10449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:55:11.910457 10449 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Bootstrap complete.
I20260808 05:55:11.911182 10449 raft_consensus.cc:348] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } }
I20260808 05:55:11.911336 10449 raft_consensus.cc:729] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 393e63224dd444b2a71eea7176a3b754, State: Initialized, Role: LEARNER
I20260808 05:55:11.911461 10449 consensus_queue.cc:260] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } }
I20260808 05:55:11.911890 10452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:11.912032 10449 sys_catalog.cc:564] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:11.912118 10452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: This master's current role is: LEARNER
I20260808 05:55:11.916503 10463 catalog_manager.cc:1259] Loaded cluster ID: 6403146fce1047268fe96d5cdc56e645
I20260808 05:55:11.916575 10463 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: loading cluster ID for follower catalog manager: success
I20260808 05:55:11.918785 10463 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: acquiring CA information for follower catalog manager: success
I20260808 05:55:11.920275 10463 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 05:55:11.923740 10365 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:11.923990 10365 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:11.924036 10365 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:11.928244 10365 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:11.928310 10365 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:11.928402 10365 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:11.934207 10365 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab
--principal=oryx/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:39411
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=46869
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423,127.2.191.124:38871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10365
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:11.935366 10365 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:11.936432 10365 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:11.949165 10475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.949246 10472 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:11.949374 10471 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:11.950052 10365 server_base.cc:1034] running on GCE node
I20260808 05:55:11.950510 10365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:11.951222 10365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:11.952380 10365 hybrid_clock.cc:648] HybridClock initialized: now 1786168511952336 us; error 55 us; skew 500 ppm
Aug 08 05:55:11 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:11.955581 10365 init.cc:377] Logged in from keytab as oryx/127.2.191.65@KRBTEST.COM (short username oryx)
I20260808 05:55:11.956790 10365 webserver.cc:460] Webserver started at http://127.2.191.65:46869/ using document root <none> and password file <none>
I20260808 05:55:11.957377 10365 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:11.957451 10365 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:11.961406 10365 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s
I20260808 05:55:11.963526 10483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.964851 10365 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:11.964967 10365 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "96fe63e894c34b0d9829bc70894764c1"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "e5368896daa7baa3806ef9c88e0fa0f3"
server_key_iv: "f8af37ab809754014516f67d5258355c"
server_key_version: "encryptionkey@0"
I20260808 05:55:11.965525 10365 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:11.979053 10365 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:11.982829 10365 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:11.983057 10365 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:11.983785 10365 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:11.984841 10365 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:11.984892 10365 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.984957 10365 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:11.984987 10365 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:11.998209 10365 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:39411
I20260808 05:55:11.998338 10611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:39411 every 8 connection(s)
I20260808 05:55:11.999337 10365 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:12.007535 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 10365
I20260808 05:55:12.007781 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 9772
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.124@KRBTEST.COM
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.125@KRBTEST.COM
I20260808 05:55:12.018399 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.001593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:47177 (local address 127.2.191.125:37423)
0808 05:55:12.001759 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.001765 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.003561 (+ 1796us) server_negotiation.cc:407] Connection header received
0808 05:55:12.004290 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.004294 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.004359 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.004469 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.005925 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.006766 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.008499 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.009041 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.009138 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.013198 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.013205 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.013211 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.013245 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.015489 (+ 2244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.016286 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.016290 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.016292 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.016383 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.016891 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.016895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.016896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.017127 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.017209 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.018077 (+ 868us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.018217 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 05:55:12.019248 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.001569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:41613 (local address 127.2.191.124:38871)
0808 05:55:12.001848 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.001852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.003780 (+ 1928us) server_negotiation.cc:407] Connection header received
0808 05:55:12.004407 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.004410 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.004470 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.004551 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.005973 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.006685 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.009078 (+ 2393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.009370 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.009491 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.012953 (+ 3462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.012959 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.012965 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.012999 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.015469 (+ 2470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.016286 (+ 817us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.016289 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.016291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.016383 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.016883 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.016886 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.016887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.017135 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.017227 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.018952 (+ 1725us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.019085 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":97,"threads_started":1}
I20260808 05:55:12.019616 10619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.002121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:38871 (local address 127.2.191.65:41613)
0808 05:55:12.003689 (+ 1568us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.003700 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.004060 (+ 360us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.004676 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.004679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.005278 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.005817 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.005827 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.006899 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.006902 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.008945 (+ 2043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.008955 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.009497 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.009500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.009754 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.010453 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.010493 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.012633 (+ 2140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.015618 (+ 2985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.015627 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.015646 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.016161 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.016494 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.016497 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.016499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.016764 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.017287 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.017294 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.017770 (+ 476us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.017997 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.018369 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1498,"mutex_wait_us":1012,"spinlock_wait_cycles":49792,"thread_start_us":275,"threads_started":1}
I20260808 05:55:12.019654 10618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.002118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.2.191.65:47177)
0808 05:55:12.003451 (+ 1333us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.003464 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.004061 (+ 597us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.004658 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.004666 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.005220 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.005775 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.005790 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.006916 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.006919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.008324 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.008340 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.009415 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.009425 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.009762 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.010643 (+ 881us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.010672 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.013015 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.015632 (+ 2617us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.015634 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.015646 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.016161 (+ 515us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.016495 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.016497 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.016499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.016764 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.017287 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.017294 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.017770 (+ 476us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.018564 (+ 794us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.018711 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1249,"mutex_wait_us":246,"spinlock_wait_cycles":53376,"thread_start_us":347,"threads_started":1}
I20260808 05:55:12.021363 10612 heartbeater.cc:347] Connected to a master server at 127.2.191.124:38871
I20260808 05:55:12.021629 10612 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.022256 10612 heartbeater.cc:511] Master 127.2.191.124:38871 requested a full tablet report, sending...
I20260808 05:55:12.023893 10402 ts_manager.cc:194] Registered new tserver with Master: 96fe63e894c34b0d9829bc70894764c1 (127.2.191.65:39411)
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168511, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:12.026731 10614 heartbeater.cc:347] Connected to a master server at 127.2.191.125:37423
I20260808 05:55:12.026839 10614 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.027037 10614 heartbeater.cc:511] Master 127.2.191.125:37423 requested a full tablet report, sending...
I20260808 05:55:12.028410 10205 ts_manager.cc:194] Registered new tserver with Master: 96fe63e894c34b0d9829bc70894764c1 (127.2.191.65:39411)
I20260808 05:55:12.028759 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.002183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:55647 (local address 127.2.191.126:36447)
0808 05:55:12.002327 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.002332 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.002973 (+ 641us) server_negotiation.cc:407] Connection header received
0808 05:55:12.004327 (+ 1354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.004331 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.004393 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.004446 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.006009 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.006784 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.020788 (+ 14004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.021149 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.021258 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.024798 (+ 3540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.024806 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.024812 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.024852 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.026727 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.027203 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.027207 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.027209 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.027307 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.027650 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.027654 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.027655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.027888 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.027997 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.028375 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.028560 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:55:12.029158 10617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.002118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:55647)
0808 05:55:12.002813 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.002867 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.004060 (+ 1193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.004660 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.004667 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.005278 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.005826 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.005833 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.006916 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.006919 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.020597 (+ 13678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.020628 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.021342 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.021349 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.021545 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.022854 (+ 1309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.022873 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.024579 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.026853 (+ 2274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.026856 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.026858 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.027090 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.027428 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.027434 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.027439 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.027537 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.028004 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.028010 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.028126 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.028257 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.028430 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"mutex_wait_us":11257,"spinlock_wait_cycles":1280,"thread_start_us":291,"threads_started":1}
I20260808 05:55:12.029966 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:40141
--local_ip_for_outbound_sockets=127.2.191.66
--tserver_master_addrs=127.2.191.126:36447
--webserver_port=34933
--webserver_interface=127.2.191.66
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab
--principal=oryx/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423,127.2.191.124:38871 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:55:12.030143 10613 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36447
I20260808 05:55:12.030232 10613 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.030462 10613 heartbeater.cc:511] Master 127.2.191.126:36447 requested a full tablet report, sending...
I20260808 05:55:12.031462 9561 ts_manager.cc:194] Re-registered known tserver with Master: 96fe63e894c34b0d9829bc70894764c1 (127.2.191.65:39411)
I20260808 05:55:12.032301 9561 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:55647
I20260808 05:55:12.101850 10053 heartbeater.cc:503] Master 127.2.191.126:36447 was elected leader, sending a full tablet report...
W20260808 05:55:12.149343 10620 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:12.149644 10620 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:12.149717 10620 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:12.154021 10620 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:12.154112 10620 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:12.154201 10620 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:12.159775 10620 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab
--principal=oryx/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:40141
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=34933
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423,127.2.191.124:38871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:12.161021 10620 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:12.162086 10620 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:12.172547 10627 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:12.172611 10626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:12.172711 10620 server_base.cc:1034] running on GCE node
W20260808 05:55:12.172564 10630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:12.173454 10620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:12.174149 10620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:12.175343 10620 hybrid_clock.cc:648] HybridClock initialized: now 1786168512175321 us; error 34 us; skew 500 ppm
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168512, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:12.178418 10620 init.cc:377] Logged in from keytab as oryx/127.2.191.66@KRBTEST.COM (short username oryx)
I20260808 05:55:12.179423 10620 webserver.cc:460] Webserver started at http://127.2.191.66:34933/ using document root <none> and password file <none>
I20260808 05:55:12.180064 10620 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:12.180199 10620 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:12.184535 10620 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:12.186897 10637 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:12.188269 10620 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:12.188421 10620 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "8e952373d5cd410187fbdc3aaa5723fb"
format_stamp: "Formatted at 2026-08-08 05:55:10 on dist-test-slave-qg60"
server_key: "7175e0343592249dc656e69331668667"
server_key_iv: "5d109304d1b93b15f2a55c11df0c3ce9"
server_key_version: "encryptionkey@0"
I20260808 05:55:12.189088 10620 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:12.207422 10620 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:12.211737 10620 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:12.211988 10620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:12.212944 10620 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:12.213974 10620 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:12.214048 10620 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:12.214133 10620 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:12.214184 10620 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:12.225275 10620 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:40141
I20260808 05:55:12.225317 10762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:40141 every 8 connection(s)
I20260808 05:55:12.226492 10620 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:12.227991 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 10620
I20260808 05:55:12.228224 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 9919
I20260808 05:55:12.237749 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:43757
--local_ip_for_outbound_sockets=127.2.191.67
--tserver_master_addrs=127.2.191.126:36447
--webserver_port=43625
--webserver_interface=127.2.191.67
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab
--principal=oryx/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423,127.2.191.124:38871 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168512, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.125@KRBTEST.COM
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168512, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168512, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.124@KRBTEST.COM
I20260808 05:55:12.249727 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.230140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:36463 (local address 127.2.191.124:38871)
0808 05:55:12.230296 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.230301 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.233061 (+ 2760us) server_negotiation.cc:407] Connection header received
0808 05:55:12.233274 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.233278 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.233334 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.233393 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.235285 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.236199 (+ 914us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.240250 (+ 4051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.240715 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.240845 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.245085 (+ 4240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.245091 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.245096 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.245134 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.247302 (+ 2168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.247767 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.247772 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.247774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.247887 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.248276 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.248282 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.248287 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.248563 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.248661 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.249341 (+ 680us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.249523 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 05:55:12.249778 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.230701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:60375 (local address 127.2.191.126:36447)
0808 05:55:12.230894 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.230902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.231317 (+ 415us) server_negotiation.cc:407] Connection header received
0808 05:55:12.232803 (+ 1486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.232807 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.232881 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.232991 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.235235 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.236174 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.239092 (+ 2918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.239470 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.239564 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.244219 (+ 4655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.244224 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.244228 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.244263 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.246756 (+ 2493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.248213 (+ 1457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.248220 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.248225 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.248332 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.248680 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.248684 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.248686 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.248990 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.249105 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.249499 (+ 394us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.249632 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 05:55:12.249771 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.233504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:56549 (local address 127.2.191.125:37423)
0808 05:55:12.233651 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.233658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.233955 (+ 297us) server_negotiation.cc:407] Connection header received
0808 05:55:12.234160 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.234163 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.234222 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.234320 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.235217 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.236079 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.238402 (+ 2323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.238849 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.238970 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.244456 (+ 5486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.244464 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.244470 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.244511 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.246501 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.247376 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.247382 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.247387 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.247494 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.248004 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.248010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.248014 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.248302 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.248410 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.249362 (+ 952us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.249513 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 05:55:12.251829 10768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.229409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:60375)
0808 05:55:12.231127 (+ 1718us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.231190 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.232465 (+ 1275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.233338 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.233348 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.234121 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.235044 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.235062 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.236350 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.236353 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.238909 (+ 2556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.238922 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.239850 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.239854 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.239978 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.241613 (+ 1635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.241636 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.243802 (+ 2166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.247803 (+ 4001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.247806 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.247808 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.248077 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.248462 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.248465 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.248467 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.248553 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.249170 (+ 617us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.249173 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.249291 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.250069 (+ 778us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.250555 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1474,"mutex_wait_us":695,"thread_start_us":236,"threads_started":1}
I20260808 05:55:12.252123 10769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.229409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:38871 (local address 127.2.191.66:36463)
0808 05:55:12.232948 (+ 3539us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.232968 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.233141 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.233557 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.233560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.234527 (+ 967us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.235125 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.235138 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.236354 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.236356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.239685 (+ 3329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.239696 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.241050 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.241054 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.241156 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.242495 (+ 1339us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.242517 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.244856 (+ 2339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.247432 (+ 2576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.247435 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.247436 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.247641 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.248019 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.248025 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.248027 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.248154 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.248750 (+ 596us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.248757 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.249019 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.249933 (+ 914us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.250498 (+ 565us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3420,"mutex_wait_us":2098,"spinlock_wait_cycles":8704,"thread_start_us":102,"threads_started":1}
I20260808 05:55:12.251830 10770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.233058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.2.191.66:56549)
0808 05:55:12.233864 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.233879 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.234025 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.234355 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.234361 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.234618 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.235034 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.235059 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.236313 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.236319 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.238243 (+ 1924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.238256 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.239452 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.239457 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.239705 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.240706 (+ 1001us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.240769 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.244273 (+ 3504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.246713 (+ 2440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.246722 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.246746 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.247218 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.247646 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.247652 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.247655 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.247874 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.248517 (+ 643us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.248525 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.249020 (+ 495us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.250721 (+ 1701us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.250913 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":725,"mutex_wait_us":252,"spinlock_wait_cycles":5376,"thread_start_us":146,"threads_started":1}
I20260808 05:55:12.253515 10764 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36447
I20260808 05:55:12.253517 10763 heartbeater.cc:347] Connected to a master server at 127.2.191.124:38871
I20260808 05:55:12.253616 10766 heartbeater.cc:347] Connected to a master server at 127.2.191.125:37423
I20260808 05:55:12.253829 10764 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.253827 10766 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.253829 10763 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.254521 10763 heartbeater.cc:511] Master 127.2.191.124:38871 requested a full tablet report, sending...
I20260808 05:55:12.254601 10766 heartbeater.cc:511] Master 127.2.191.125:37423 requested a full tablet report, sending...
I20260808 05:55:12.254521 10764 heartbeater.cc:511] Master 127.2.191.126:36447 requested a full tablet report, sending...
I20260808 05:55:12.255818 9561 ts_manager.cc:194] Re-registered known tserver with Master: 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141)
I20260808 05:55:12.255848 10205 ts_manager.cc:194] Registered new tserver with Master: 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141)
I20260808 05:55:12.255945 10402 ts_manager.cc:194] Registered new tserver with Master: 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141)
I20260808 05:55:12.256664 9561 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:60375
I20260808 05:55:12.267086 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.263845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44042 (local address 127.2.191.124:38871)
0808 05:55:12.263987 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.263992 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.264007 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:55:12.264094 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.264098 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.264183 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.264290 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:12.264538 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.265148 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.266135 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.266562 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.266696 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.266857 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.266895 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.266959 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:55:12.267086 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.263712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:38871 (local address 127.0.0.1:44042)
0808 05:55:12.263848 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.263889 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.263987 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.264304 (+ 317us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.264307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.264325 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:12.264427 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.264433 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.265259 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.265266 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.265999 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.266008 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.266699 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.266703 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.266784 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.266806 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.266873 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.266952 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260808 05:55:12.267771 10413 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 05:55:12.268146 10452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eba2996fd09d42aa8bd020146491a69d. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:12.268301 10452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: This master's current role is: LEARNER
W20260808 05:55:12.361177 10772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:12.361449 10772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:12.361526 10772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:12.365607 10772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:12.365669 10772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:12.365757 10772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:12.371363 10772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab
--principal=oryx/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:43757
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=43625
--tserver_master_addrs=127.2.191.126:36447,127.2.191.125:37423,127.2.191.124:38871
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:12.372466 10772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:12.373554 10772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:12.384258 10778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:12.384302 10777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:12.384464 10772 server_base.cc:1034] running on GCE node
W20260808 05:55:12.384279 10780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:12.385039 10772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:12.385665 10772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:12.386822 10772 hybrid_clock.cc:648] HybridClock initialized: now 1786168512386787 us; error 47 us; skew 500 ppm
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168512, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:12.389791 10772 init.cc:377] Logged in from keytab as oryx/127.2.191.67@KRBTEST.COM (short username oryx)
I20260808 05:55:12.390669 10772 webserver.cc:460] Webserver started at http://127.2.191.67:43625/ using document root <none> and password file <none>
I20260808 05:55:12.391245 10772 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:12.391345 10772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:12.395454 10772 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:55:12.397540 10787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:12.398782 10772 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:55:12.398916 10772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "4ee95ab20a744f07be295b65a58f6e27"
format_stamp: "Formatted at 2026-08-08 05:55:11 on dist-test-slave-qg60"
server_key: "c981baf4e79706b8a5d41416352672a1"
server_key_iv: "467ca2cd5c64f969de122a6d0072895b"
server_key_version: "encryptionkey@0"
I20260808 05:55:12.399447 10772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:12.423463 10772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:12.426669 10772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:12.426874 10772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:12.427526 10772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:12.428428 10772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:12.428503 10772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:12.428577 10772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:12.428637 10772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:12.439829 10772 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:43757
I20260808 05:55:12.439852 10910 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:43757 every 8 connection(s)
I20260808 05:55:12.440919 10772 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:12.446501 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 10772
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168512, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.124@KRBTEST.COM
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168512, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
Aug 08 05:55:12 dist-test-slave-qg60 krb5kdc[9513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168512, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.125@KRBTEST.COM
I20260808 05:55:12.464414 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.450089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44052 (local address 127.2.191.124:38871)
0808 05:55:12.451199 (+ 1110us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.451205 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.451635 (+ 430us) server_negotiation.cc:407] Connection header received
0808 05:55:12.451688 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.451691 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.451742 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.451833 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.456082 (+ 4249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.456877 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.458089 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.458337 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.458450 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.460041 (+ 1591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.460044 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.460047 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.460070 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.462302 (+ 2232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.462866 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.462872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.462876 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.462976 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.463317 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.463322 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.463327 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.463562 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.463696 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.464075 (+ 379us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.464221 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1038,"thread_start_us":217,"threads_started":1}
I20260808 05:55:12.465210 9603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.443598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:40009 (local address 127.2.191.126:36447)
0808 05:55:12.443713 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.443719 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.444293 (+ 574us) server_negotiation.cc:407] Connection header received
0808 05:55:12.445663 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.445666 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.445737 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.445789 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.447685 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.448542 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.451370 (+ 2828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.451722 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.451831 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.455527 (+ 3696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.455531 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.455533 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.455564 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.460993 (+ 5429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.462602 (+ 1609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.462606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.462609 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.462705 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.464160 (+ 1455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.464175 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.464177 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.464385 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.464484 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.464916 (+ 432us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.465042 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 05:55:12.465543 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.442968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:40125 (local address 127.2.191.125:37423)
0808 05:55:12.443140 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.443145 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.444622 (+ 1477us) server_negotiation.cc:407] Connection header received
0808 05:55:12.445656 (+ 1034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.445660 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.445721 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.445782 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.447680 (+ 1898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.448542 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.451526 (+ 2984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.452225 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.452582 (+ 357us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.455571 (+ 2989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.455577 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.455581 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.455630 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.458251 (+ 2621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.460182 (+ 1931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.460186 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.460188 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.460296 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.460806 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.460813 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.460818 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.463774 (+ 2956us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.463873 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.465270 (+ 1397us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.465403 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":70}
I20260808 05:55:12.465885 10927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.450667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53804 (local address 127.2.191.125:37423)
0808 05:55:12.454236 (+ 3569us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.454240 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.454254 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:12.454289 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.454292 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.454336 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.454436 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.456550 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.457695 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.459010 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.459380 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.459936 (+ 556us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.461228 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.461232 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.461236 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.461273 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.463258 (+ 1985us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.463722 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.463728 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.463733 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.463830 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.464162 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.464168 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.464172 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.464361 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.465144 (+ 783us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.465221 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.465726 (+ 505us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3484,"spinlock_wait_cycles":3200,"thread_start_us":97,"threads_started":1}
I20260808 05:55:12.466872 10918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.443450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:38871 (local address 127.2.191.67:34795)
0808 05:55:12.444551 (+ 1101us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.444564 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.445396 (+ 832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.445962 (+ 566us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.445970 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.446694 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.447486 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.447512 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.448609 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.448611 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.450477 (+ 1866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.450505 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.451136 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.451140 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.451371 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.452044 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.452065 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.461495 (+ 9430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.464594 (+ 3099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.464598 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.464612 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.464940 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.465830 (+ 890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.465833 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.465835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.465932 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.466383 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.466386 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.466481 (+ 95us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.466577 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.466718 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1004,"mutex_wait_us":555,"spinlock_wait_cycles":14720,"thread_start_us":154,"threads_started":1}
I20260808 05:55:12.466944 10917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.443478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:40009)
0808 05:55:12.444136 (+ 658us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.444191 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.445389 (+ 1198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.445985 (+ 596us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.445988 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.446693 (+ 705us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.447495 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.447511 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.448762 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.448769 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.451239 (+ 2470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.451250 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.451961 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.451966 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.452132 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.452620 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.452635 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.455334 (+ 2699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.461087 (+ 5753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.461092 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.461095 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.461374 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.463153 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.463157 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.463160 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.463274 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.464529 (+ 1255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.464532 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.464620 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.464715 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.465712 (+ 997us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":1986,"spinlock_wait_cycles":6144,"thread_start_us":129,"threads_started":1}
I20260808 05:55:12.467798 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.443170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:34795 (local address 127.2.191.124:38871)
0808 05:55:12.443299 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.443304 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.444676 (+ 1372us) server_negotiation.cc:407] Connection header received
0808 05:55:12.445616 (+ 940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.445620 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.445686 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.445779 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.447703 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.448425 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.450656 (+ 2231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.450961 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.451086 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.461677 (+ 10591us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.461683 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.461687 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.461723 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.464036 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.465066 (+ 1030us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.465071 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.465073 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.465160 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.466052 (+ 892us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.466056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.466058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.466266 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.466391 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.467508 (+ 1117us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.467650 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:55:12.468207 10913 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36447
I20260808 05:55:12.468415 10916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.443450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.2.191.67:40125)
0808 05:55:12.444503 (+ 1053us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.444516 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.445389 (+ 873us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.445978 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.445981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.446724 (+ 743us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:12.447494 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.447511 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.448698 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.448703 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.451409 (+ 2706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.451415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.452762 (+ 1347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.452768 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.452944 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.453523 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:12.453537 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:12.455387 (+ 1850us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:12.458383 (+ 2996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.458389 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.458407 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.459077 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.460419 (+ 1342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:12.460424 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:12.460429 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:12.460653 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:12.463934 (+ 3281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:12.463943 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:12.464302 (+ 359us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.464521 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.465315 (+ 794us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":962,"mutex_wait_us":1334,"thread_start_us":133,"threads_started":1}
I20260808 05:55:12.468448 10912 heartbeater.cc:347] Connected to a master server at 127.2.191.124:38871
I20260808 05:55:12.468485 10913 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.468549 10912 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.469122 10913 heartbeater.cc:511] Master 127.2.191.126:36447 requested a full tablet report, sending...
I20260808 05:55:12.469123 10912 heartbeater.cc:511] Master 127.2.191.124:38871 requested a full tablet report, sending...
I20260808 05:55:12.469313 10914 heartbeater.cc:347] Connected to a master server at 127.2.191.125:37423
I20260808 05:55:12.469405 10914 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:12.469542 10914 heartbeater.cc:511] Master 127.2.191.125:37423 requested a full tablet report, sending...
I20260808 05:55:12.470221 9561 ts_manager.cc:194] Re-registered known tserver with Master: 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757)
I20260808 05:55:12.470288 10205 ts_manager.cc:194] Registered new tserver with Master: 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757)
I20260808 05:55:12.470324 10402 ts_manager.cc:194] Registered new tserver with Master: 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757)
I20260808 05:55:12.470958 9561 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:40009
I20260808 05:55:12.471158 10923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.449543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46268 (local address 127.2.191.126:36447)
0808 05:55:12.450987 (+ 1444us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.451040 (+ 53us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.452575 (+ 1535us) server_negotiation.cc:407] Connection header received
0808 05:55:12.452820 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.452826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.452881 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.452965 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.454011 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.454642 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.456531 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.456948 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.457081 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.459701 (+ 2620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.459704 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.459707 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.459737 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.463595 (+ 3858us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.469340 (+ 5745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.469344 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.469347 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.469455 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.469897 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.469903 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.469905 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.470138 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.470262 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.470819 (+ 557us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.470948 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1359,"thread_start_us":203,"threads_started":1}
I20260808 05:55:12.474062 9561 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46268:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:12.477201 9561 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:12.479771 10161 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: NON_VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: true } } }
I20260808 05:55:12.479933 10161 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:12.483425 10930 raft_consensus.cc:1050] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: attempting to promote NON_VOTER 393e63224dd444b2a71eea7176a3b754 to VOTER
I20260808 05:55:12.483781 10930 consensus_queue.cc:237] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } }
I20260808 05:55:12.484933 10413 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 LEARNER]: Refusing update from remote peer eba2996fd09d42aa8bd020146491a69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 05:55:12.485261 10216 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Refusing update from remote peer eba2996fd09d42aa8bd020146491a69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 05:55:12.485316 10161 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 05:55:12.485618 10161 consensus_queue.cc:1035] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 05:55:12.487046 10930 raft_consensus.cc:2932] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 393e63224dd444b2a71eea7176a3b754 (127.2.191.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:12.487629 10413 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 393e63224dd444b2a71eea7176a3b754 (127.2.191.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:12.488811 10930 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:12.488914 10930 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:12.489390 10931 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:12.489514 10931 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:12.489699 10930 sys_catalog.cc:455] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:12.489802 10930 sys_catalog.cc:458] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:12.490020 10452 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:12.489980 10216 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 393e63224dd444b2a71eea7176a3b754 (127.2.191.124) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:12.490154 10452 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:55:12.493911 10939 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "eba2996fd09d42aa8bd020146491a69d" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:12.494107 10939 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:55:12.500564 10156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.494629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39411 (local address 127.0.0.1:42646)
0808 05:55:12.494962 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.494981 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.495086 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.496315 (+ 1229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.496318 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.496335 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:12.496424 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.496428 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.497707 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.497710 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.498889 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.498902 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.500102 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.500107 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.500239 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.500263 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.500338 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.500402 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"mutex_wait_us":35}
I20260808 05:55:12.501245 10942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.495297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42646 (local address 127.2.191.65:39411)
0808 05:55:12.495881 (+ 584us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.495897 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.495926 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:55:12.495992 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.495996 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.496181 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.496310 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:12.496550 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.497528 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.499046 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.499972 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.500080 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.500234 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.500922 (+ 688us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.501031 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":479,"thread_start_us":201,"threads_started":1}
I20260808 05:55:12.502089 10941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.494933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:40141 (local address 127.0.0.1:55948)
0808 05:55:12.495647 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.495670 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.495767 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.498344 (+ 2577us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.498347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.498366 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:12.498458 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.498467 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.499463 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.499468 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.500376 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.500384 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.501681 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.501685 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.501789 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.501814 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.501881 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.501951 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":647,"thread_start_us":123,"threads_started":1}
I20260808 05:55:12.502383 10940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.495067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:43757 (local address 127.0.0.1:55364)
0808 05:55:12.496539 (+ 1472us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.496553 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.496700 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.497430 (+ 730us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.497433 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.497452 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:12.497541 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.497546 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.498994 (+ 1448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.498997 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.500210 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.500222 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.501997 (+ 1775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.502001 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.502079 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.502107 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.502181 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.502259 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1384,"mutex_wait_us":1,"thread_start_us":108,"threads_started":1}
I20260808 05:55:12.502558 10943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.495393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55948 (local address 127.2.191.66:40141)
0808 05:55:12.497836 (+ 2443us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.497873 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.497899 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:55:12.497977 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.497983 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.498168 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.498367 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:12.498557 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.499342 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.500497 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.501359 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.501476 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.501612 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.502288 (+ 676us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.502387 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2341,"thread_start_us":146,"threads_started":1}
I20260808 05:55:12.503134 10944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.495506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55364 (local address 127.2.191.67:43757)
0808 05:55:12.497003 (+ 1497us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.497024 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.497043 (+ 19us) server_negotiation.cc:407] Connection header received
0808 05:55:12.497104 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.497109 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.497243 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.497442 (+ 199us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:12.497691 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.498852 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.500318 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.501660 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.501792 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.501938 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.502808 (+ 870us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.502929 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1405,"thread_start_us":132,"threads_started":1}
I20260808 05:55:12.504527 10537 tablet_service.cc:1467] Processing CreateTablet for tablet aca550926411462c9f1dad52095360bc (DEFAULT_TABLE table=test-table [id=f34584c19fcb4fc38e106c6b63ad2420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:12.505295 10690 tablet_service.cc:1467] Processing CreateTablet for tablet aca550926411462c9f1dad52095360bc (DEFAULT_TABLE table=test-table [id=f34584c19fcb4fc38e106c6b63ad2420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:12.505800 10537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca550926411462c9f1dad52095360bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:12.506220 10690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca550926411462c9f1dad52095360bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:12.506000 10838 tablet_service.cc:1467] Processing CreateTablet for tablet aca550926411462c9f1dad52095360bc (DEFAULT_TABLE table=test-table [id=f34584c19fcb4fc38e106c6b63ad2420]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:12.506915 10838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aca550926411462c9f1dad52095360bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:12.513899 10945 tablet_bootstrap.cc:492] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Bootstrap starting.
I20260808 05:55:12.515486 10946 tablet_bootstrap.cc:492] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Bootstrap starting.
I20260808 05:55:12.516350 10947 tablet_bootstrap.cc:492] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Bootstrap starting.
I20260808 05:55:12.516623 10945 tablet_bootstrap.cc:654] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:12.517962 10945 log.cc:824] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:12.518251 10946 tablet_bootstrap.cc:654] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:12.518447 10947 tablet_bootstrap.cc:654] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:12.519148 10947 log.cc:824] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:12.519541 10946 log.cc:824] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:12.520610 10945 tablet_bootstrap.cc:492] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: No bootstrap required, opened a new log
I20260808 05:55:12.520848 10945 ts_tablet_manager.cc:1397] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260808 05:55:12.521749 10947 tablet_bootstrap.cc:492] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: No bootstrap required, opened a new log
I20260808 05:55:12.521746 10946 tablet_bootstrap.cc:492] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: No bootstrap required, opened a new log
I20260808 05:55:12.521940 10947 ts_tablet_manager.cc:1397] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:55:12.521934 10946 ts_tablet_manager.cc:1397] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.005s
I20260808 05:55:12.525219 10945 raft_consensus.cc:348] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.525466 10945 raft_consensus.cc:374] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:12.525520 10945 raft_consensus.cc:729] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e952373d5cd410187fbdc3aaa5723fb, State: Initialized, Role: FOLLOWER
I20260808 05:55:12.526046 10945 consensus_queue.cc:260] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.526548 10946 raft_consensus.cc:348] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.526786 10946 raft_consensus.cc:374] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:12.526834 10946 raft_consensus.cc:729] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96fe63e894c34b0d9829bc70894764c1, State: Initialized, Role: FOLLOWER
I20260808 05:55:12.527176 10945 ts_tablet_manager.cc:1428] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:55:12.527238 10946 consensus_queue.cc:260] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.527575 10764 heartbeater.cc:503] Master 127.2.191.126:36447 was elected leader, sending a full tablet report...
I20260808 05:55:12.528119 10946 ts_tablet_manager.cc:1428] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 05:55:12.528473 10613 heartbeater.cc:503] Master 127.2.191.126:36447 was elected leader, sending a full tablet report...
I20260808 05:55:12.539479 10947 raft_consensus.cc:348] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.539793 10947 raft_consensus.cc:374] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:12.539865 10947 raft_consensus.cc:729] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ee95ab20a744f07be295b65a58f6e27, State: Initialized, Role: FOLLOWER
I20260808 05:55:12.540341 10947 consensus_queue.cc:260] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.541119 10913 heartbeater.cc:503] Master 127.2.191.126:36447 was elected leader, sending a full tablet report...
I20260808 05:55:12.541462 10947 ts_tablet_manager.cc:1428] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Time spent starting tablet: real 0.019s user 0.002s sys 0.006s
W20260808 05:55:12.692786 10915 tablet.cc:2369] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:55:12.728654 10767 tablet.cc:2369] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:55:12.752120 10615 tablet.cc:2369] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:55:12.823421 10952 raft_consensus.cc:482] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:12.823678 10952 raft_consensus.cc:504] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.825111 10952 leader_election.cc:288] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757), 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141)
I20260808 05:55:12.830559 10943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.825570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:50701 (local address 127.2.191.66:40141)
0808 05:55:12.825695 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.825700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.825878 (+ 178us) server_negotiation.cc:407] Connection header received
0808 05:55:12.826042 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.826046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.826115 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.826196 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:12.826528 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.827269 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.829200 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.829842 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.829985 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.830041 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.830332 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.830416 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:55:12.830559 10944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.825473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:59721 (local address 127.2.191.67:43757)
0808 05:55:12.825639 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.825645 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.825808 (+ 163us) server_negotiation.cc:407] Connection header received
0808 05:55:12.825989 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.825992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.826035 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.826145 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:12.826418 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.827244 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.829200 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.829846 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.829985 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.830041 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.830332 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.830415 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 05:55:12.830680 10954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.825318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:43757 (local address 127.2.191.65:59721)
0808 05:55:12.825687 (+ 369us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.825704 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.825868 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.826156 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.826159 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.826175 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:12.826285 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.826291 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.827396 (+ 1105us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.827400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.829042 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.829050 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.830030 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.830035 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.830154 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.830195 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.830295 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.830448 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293,"mutex_wait_us":181,"thread_start_us":81,"threads_started":1}
I20260808 05:55:12.830684 10955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.825467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:40141 (local address 127.2.191.65:50701)
0808 05:55:12.825771 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:12.825783 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:12.825919 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:12.826283 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:12.826286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:12.826300 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:12.826424 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.826429 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.827396 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.827400 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.829036 (+ 1636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:12.829050 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.830100 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.830104 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:12.830193 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.830217 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 05:55:12.830295 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:55:12.830448 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"mutex_wait_us":189,"thread_start_us":74,"threads_started":1}
I20260808 05:55:12.831565 10862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca550926411462c9f1dad52095360bc" candidate_uuid: "96fe63e894c34b0d9829bc70894764c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ee95ab20a744f07be295b65a58f6e27" is_pre_election: true
I20260808 05:55:12.831885 10713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca550926411462c9f1dad52095360bc" candidate_uuid: "96fe63e894c34b0d9829bc70894764c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e952373d5cd410187fbdc3aaa5723fb" is_pre_election: true
I20260808 05:55:12.831918 10862 raft_consensus.cc:2454] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96fe63e894c34b0d9829bc70894764c1 in term 0.
I20260808 05:55:12.832176 10713 raft_consensus.cc:2454] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96fe63e894c34b0d9829bc70894764c1 in term 0.
I20260808 05:55:12.832494 10485 leader_election.cc:302] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ee95ab20a744f07be295b65a58f6e27, 96fe63e894c34b0d9829bc70894764c1; no voters:
I20260808 05:55:12.832865 10952 raft_consensus.cc:2781] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:12.832965 10952 raft_consensus.cc:482] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:12.833011 10952 raft_consensus.cc:3037] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:12.834136 10952 raft_consensus.cc:504] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.834523 10952 leader_election.cc:288] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757), 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141)
I20260808 05:55:12.834892 10862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca550926411462c9f1dad52095360bc" candidate_uuid: "96fe63e894c34b0d9829bc70894764c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ee95ab20a744f07be295b65a58f6e27"
I20260808 05:55:12.834981 10713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aca550926411462c9f1dad52095360bc" candidate_uuid: "96fe63e894c34b0d9829bc70894764c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e952373d5cd410187fbdc3aaa5723fb"
I20260808 05:55:12.835041 10862 raft_consensus.cc:3037] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:12.835139 10713 raft_consensus.cc:3037] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:12.836354 10862 raft_consensus.cc:2454] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96fe63e894c34b0d9829bc70894764c1 in term 1.
I20260808 05:55:12.836377 10713 raft_consensus.cc:2454] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96fe63e894c34b0d9829bc70894764c1 in term 1.
I20260808 05:55:12.836680 10485 leader_election.cc:302] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ee95ab20a744f07be295b65a58f6e27, 96fe63e894c34b0d9829bc70894764c1; no voters:
I20260808 05:55:12.836933 10952 raft_consensus.cc:2781] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:12.837191 10952 raft_consensus.cc:686] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 1 LEADER]: Becoming Leader. State: Replica: 96fe63e894c34b0d9829bc70894764c1, State: Running, Role: LEADER
I20260808 05:55:12.837941 10952 consensus_queue.cc:237] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:12.841889 9562 catalog_manager.cc:5495] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96fe63e894c34b0d9829bc70894764c1 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "96fe63e894c34b0d9829bc70894764c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260808 05:55:12.873805 10942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.869694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42656 (local address 127.2.191.65:39411)
0808 05:55:12.869816 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.869820 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.869888 (+ 68us) server_negotiation.cc:407] Connection header received
0808 05:55:12.870220 (+ 332us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.870223 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.870281 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.870369 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:12.870650 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.871183 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.872094 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.872300 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.872376 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.872840 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:12.873303 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:12.873409 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.873534 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.873591 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:55:12.880548 10862 raft_consensus.cc:1261] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 1 FOLLOWER]: Refusing update from remote peer 96fe63e894c34b0d9829bc70894764c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:12.880615 10713 raft_consensus.cc:1261] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 1 FOLLOWER]: Refusing update from remote peer 96fe63e894c34b0d9829bc70894764c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:12.881438 10956 consensus_queue.cc:1035] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:12.881740 10952 consensus_queue.cc:1035] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:12.891388 10959 mvcc.cc:205] Tried to move back new op lower bound from 7316146228750372864 to 7316146228587663360. Current Snapshot: MvccSnapshot[applied={T|T < 7316146228750372864}]
I20260808 05:55:12.891943 10962 mvcc.cc:205] Tried to move back new op lower bound from 7316146228750372864 to 7316146228587663360. Current Snapshot: MvccSnapshot[applied={T|T < 7316146228750372864}]
I20260808 05:55:12.904845 9562 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:12.905084 9562 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46268:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:12.909917 9562 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eba2996fd09d42aa8bd020146491a69d: Sending DeleteTablet for 3 replicas of tablet aca550926411462c9f1dad52095360bc
I20260808 05:55:12.910955 10838 tablet_service.cc:1514] Processing DeleteTablet for tablet aca550926411462c9f1dad52095360bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:12 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:55364
I20260808 05:55:12.911021 10537 tablet_service.cc:1514] Processing DeleteTablet for tablet aca550926411462c9f1dad52095360bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:12 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:42646
I20260808 05:55:12.914325 10690 tablet_service.cc:1514] Processing DeleteTablet for tablet aca550926411462c9f1dad52095360bc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:12 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:55948
I20260808 05:55:12.914824 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 9527
I20260808 05:55:12.917502 10974 tablet_replica.cc:330] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: stopping tablet replica
I20260808 05:55:12.917940 10974 raft_consensus.cc:2229] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:12.918388 10974 raft_consensus.cc:2258] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:12.920478 10974 ts_tablet_manager.cc:1905] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:12.924970 10974 ts_tablet_manager.cc:1918] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:12.925120 10974 log.cc:1196] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/aca550926411462c9f1dad52095360bc
I20260808 05:55:12.925041 10971 tablet_replica.cc:330] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: stopping tablet replica
I20260808 05:55:12.925519 10974 ts_tablet_manager.cc:1939] T aca550926411462c9f1dad52095360bc P 8e952373d5cd410187fbdc3aaa5723fb: Deleting consensus metadata
I20260808 05:55:12.925762 10971 raft_consensus.cc:2229] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:55:12.926573 10971 raft_consensus.cc:2258] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 05:55:12.927022 10639 connection.cc:441] server connection from 127.0.0.1:55948 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55948 (request call id 1) could send its response
I20260808 05:55:12.928686 10971 ts_tablet_manager.cc:1905] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:12.931751 10971 ts_tablet_manager.cc:1918] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:12.933451 10970 tablet_replica.cc:330] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: stopping tablet replica
I20260808 05:55:12.933934 10970 raft_consensus.cc:2229] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:12.936403 10970 raft_consensus.cc:2258] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:12.937381 10971 log.cc:1196] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/aca550926411462c9f1dad52095360bc
I20260808 05:55:12.937808 10971 ts_tablet_manager.cc:1939] T aca550926411462c9f1dad52095360bc P 96fe63e894c34b0d9829bc70894764c1: Deleting consensus metadata
W20260808 05:55:12.939069 10487 connection.cc:441] server connection from 127.0.0.1:42646 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:42646 (request call id 1) could send its response
I20260808 05:55:12.940233 10970 ts_tablet_manager.cc:1905] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:12.943105 10970 ts_tablet_manager.cc:1918] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:12.943224 10970 log.cc:1196] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/aca550926411462c9f1dad52095360bc
I20260808 05:55:12.944193 10970 ts_tablet_manager.cc:1939] T aca550926411462c9f1dad52095360bc P 4ee95ab20a744f07be295b65a58f6e27: Deleting consensus metadata
W20260808 05:55:12.945744 10788 connection.cc:441] server connection from 127.0.0.1:55364 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55364 (request call id 1) could send its response
I20260808 05:55:12.945791 10342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.930155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53834 (local address 127.2.191.125:37423)
0808 05:55:12.930307 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.930312 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.931197 (+ 885us) server_negotiation.cc:407] Connection header received
0808 05:55:12.931365 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.931371 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.931421 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.931473 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.932682 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.933544 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.934724 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.935068 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.935145 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.941070 (+ 5925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.941075 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.941078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.941110 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.943183 (+ 2073us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.943833 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.943839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.943840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.943937 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.944297 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.944303 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.944305 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.944612 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.944785 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.945447 (+ 662us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.945593 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:55:12.946810 10924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.930765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44074 (local address 127.2.191.124:38871)
0808 05:55:12.930895 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.930901 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.931015 (+ 114us) server_negotiation.cc:407] Connection header received
0808 05:55:12.931255 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.931259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.931332 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.931390 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.933113 (+ 1723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.933885 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.935312 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.935692 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.935769 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.941071 (+ 5302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.941075 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.941078 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.941169 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.943275 (+ 2106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.943859 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.943862 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.943864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.943951 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.945651 (+ 1700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.945655 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.945657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.945886 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.945999 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.946420 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.946599 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:55:12.950059 10927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.913864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53818 (local address 127.2.191.125:37423)
0808 05:55:12.914019 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.914024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.927508 (+ 13484us) server_negotiation.cc:407] Connection header received
0808 05:55:12.931992 (+ 4484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.931996 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.932046 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.932100 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.934123 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.934924 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.937246 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.937592 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.937745 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.945991 (+ 8246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.945995 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.945997 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.946024 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.948079 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.948558 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.948562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.948564 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.948661 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.949164 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.949167 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.949169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.949352 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.949489 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.949742 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.949877 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 05:55:12.959643 10616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:12.912821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44064 (local address 127.2.191.124:38871)
0808 05:55:12.912945 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:12.912950 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:12.950400 (+ 37450us) server_negotiation.cc:407] Connection header received
0808 05:55:12.950792 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:12.950795 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:12.950850 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:12.950931 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:12.952539 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.953162 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.954261 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:12.954471 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:12.954552 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:12.956201 (+ 1649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:12.956205 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:12.956208 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:12.956233 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:12.957896 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.958313 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.958317 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.958319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.958429 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:12.958723 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:12.958727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:12.958728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:12.958950 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:12.959087 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:12.959328 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 05:55:12.959449 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:55:13.896035 10984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:13.895457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:47917)
0808 05:55:13.895772 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:13.895886 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":99,"threads_started":1}
W20260808 05:55:13.896526 10764 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:36447 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:13.897969 10985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:13.897539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:46687)
0808 05:55:13.897799 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:13.897875 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":66,"threads_started":1}
W20260808 05:55:13.898309 10913 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:36447 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:13.899112 10986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:13.898720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:33977)
0808 05:55:13.898928 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:13.899013 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":71,"threads_started":1}
W20260808 05:55:13.899684 10613 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:36447 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:14.410143 10987 raft_consensus.cc:482] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eba2996fd09d42aa8bd020146491a69d)
I20260808 05:55:14.410454 10987 raft_consensus.cc:504] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } }
I20260808 05:55:14.410638 10988 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eba2996fd09d42aa8bd020146491a69d)
I20260808 05:55:14.410843 10988 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } }
I20260808 05:55:14.411738 10987 leader_election.cc:288] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447), 3ba5eece9c114c62b0e5f637884b95e8 (127.2.191.125:37423)
I20260808 05:55:14.411899 10988 leader_election.cc:288] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447), 393e63224dd444b2a71eea7176a3b754 (127.2.191.124:38871)
I20260808 05:55:14.412391 10989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.411806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50578)
0808 05:55:14.412168 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.412264 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":63,"threads_started":1}
W20260808 05:55:14.412684 10394 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:14.413254 10993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.412480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50592)
0808 05:55:14.413022 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.413138 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":64,"threads_started":1}
W20260808 05:55:14.413416 10189 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:14.413983 10989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.413710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50604)
0808 05:55:14.413868 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.413917 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260808 05:55:14.414147 10394 leader_election.cc:334] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447): Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:14.414347 10993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.414100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50612)
0808 05:55:14.414237 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.414283 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 05:55:14.414484 10189 leader_election.cc:334] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447): Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:14.416597 10992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.412214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39536 (local address 127.2.191.125:37423)
0808 05:55:14.412892 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:14.412897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:14.412912 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:55:14.413067 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:14.413072 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:14.413167 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:14.413247 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:14.413684 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:14.414476 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:14.415583 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:14.416013 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:14.416140 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:14.416200 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:14.416380 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 05:55:14.416456 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":284,"server-negotiator.queue_time_us":609,"thread_start_us":67,"threads_started":1}
I20260808 05:55:14.416589 10994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.412631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37476 (local address 127.2.191.124:38871)
0808 05:55:14.412853 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:14.412858 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:14.412871 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:14.412917 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:14.412923 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:14.412981 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:14.413511 (+ 530us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:14.413622 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:14.414455 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:14.415566 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:14.415967 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:14.416101 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:14.416163 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:14.416349 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 05:55:14.416436 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":157,"thread_start_us":70,"threads_started":1}
I20260808 05:55:14.416599 10990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.411960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:37423 (local address 127.0.0.1:39536)
0808 05:55:14.412784 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.412800 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:14.412906 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:14.413347 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:14.413351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:14.413369 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:14.413476 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:14.413483 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:14.414616 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:14.414620 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:14.415444 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:14.415454 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:14.416143 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:14.416147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:14.416241 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:14.416271 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 05:55:14.416364 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 05:55:14.416450 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":729,"mutex_wait_us":176,"thread_start_us":89,"threads_started":1}
I20260808 05:55:14.416637 10991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.412222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:38871 (local address 127.0.0.1:37476)
0808 05:55:14.412492 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.412508 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:14.412612 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:14.413161 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:14.413164 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:14.413186 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:14.413364 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:14.413372 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:14.414599 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:14.414603 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:14.415430 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:14.415439 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:14.416109 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:14.416112 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:14.416205 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:14.416228 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 05:55:14.416332 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 05:55:14.416421 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":25,"thread_start_us":76,"threads_started":1}
I20260808 05:55:14.417160 10216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "393e63224dd444b2a71eea7176a3b754" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3ba5eece9c114c62b0e5f637884b95e8" is_pre_election: true
I20260808 05:55:14.417402 10216 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 393e63224dd444b2a71eea7176a3b754 in term 1.
I20260808 05:55:14.417375 10413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ba5eece9c114c62b0e5f637884b95e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "393e63224dd444b2a71eea7176a3b754" is_pre_election: true
I20260808 05:55:14.417572 10413 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ba5eece9c114c62b0e5f637884b95e8 in term 1.
I20260808 05:55:14.417832 10395 leader_election.cc:302] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 393e63224dd444b2a71eea7176a3b754, 3ba5eece9c114c62b0e5f637884b95e8; no voters: eba2996fd09d42aa8bd020146491a69d
I20260808 05:55:14.418042 10987 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 05:55:14.418102 10987 raft_consensus.cc:482] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eba2996fd09d42aa8bd020146491a69d)
I20260808 05:55:14.418133 10987 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:55:14.418299 10188 leader_election.cc:302] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 393e63224dd444b2a71eea7176a3b754, 3ba5eece9c114c62b0e5f637884b95e8; no voters: eba2996fd09d42aa8bd020146491a69d
I20260808 05:55:14.418504 10988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 05:55:14.418565 10988 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eba2996fd09d42aa8bd020146491a69d)
I20260808 05:55:14.418606 10988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:55:14.419346 10987 raft_consensus.cc:504] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } }
I20260808 05:55:14.419639 10988 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } }
I20260808 05:55:14.419745 10987 leader_election.cc:288] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 2 election: Requested vote from peers eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447), 3ba5eece9c114c62b0e5f637884b95e8 (127.2.191.125:37423)
I20260808 05:55:14.420044 10216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "393e63224dd444b2a71eea7176a3b754" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3ba5eece9c114c62b0e5f637884b95e8"
I20260808 05:55:14.420047 10988 leader_election.cc:288] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [CANDIDATE]: Term 2 election: Requested vote from peers eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447), 393e63224dd444b2a71eea7176a3b754 (127.2.191.124:38871)
I20260808 05:55:14.420213 10990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.419867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50628)
0808 05:55:14.420069 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.420142 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260808 05:55:14.420236 10216 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 393e63224dd444b2a71eea7176a3b754 in current term 2: Already voted for candidate 3ba5eece9c114c62b0e5f637884b95e8 in this term.
I20260808 05:55:14.420409 10991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.420130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50638)
0808 05:55:14.420292 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.420344 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260808 05:55:14.420481 10413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3ba5eece9c114c62b0e5f637884b95e8" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "393e63224dd444b2a71eea7176a3b754"
I20260808 05:55:14.420626 10413 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3ba5eece9c114c62b0e5f637884b95e8 in current term 2: Already voted for candidate 393e63224dd444b2a71eea7176a3b754 in this term.
I20260808 05:55:14.421123 10990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.420837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50644)
0808 05:55:14.421022 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.421073 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260808 05:55:14.421187 10991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.420980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50654)
0808 05:55:14.421066 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.421124 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 05:55:14.421231 10394 leader_election.cc:334] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447): Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:14.421300 10394 leader_election.cc:302] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 393e63224dd444b2a71eea7176a3b754; no voters: 3ba5eece9c114c62b0e5f637884b95e8, eba2996fd09d42aa8bd020146491a69d
W20260808 05:55:14.421300 10189 leader_election.cc:334] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447): Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:14.421357 10189 leader_election.cc:302] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3ba5eece9c114c62b0e5f637884b95e8; no voters: 393e63224dd444b2a71eea7176a3b754, eba2996fd09d42aa8bd020146491a69d
I20260808 05:55:14.421482 10987 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 05:55:14.421528 10988 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260808 05:55:14.897588 10997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.897125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:49785)
0808 05:55:14.897390 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.897479 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":103,"threads_started":1}
I20260808 05:55:14.899231 10998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.898808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:38965)
0808 05:55:14.899079 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.899153 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":82,"threads_started":1}
I20260808 05:55:14.900664 10999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:14.900247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:47201)
0808 05:55:14.900497 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:14.900564 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":86,"threads_started":1}
I20260808 05:55:15.899212 11000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:15.898650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:59365)
0808 05:55:15.898956 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:15.899034 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":90,"threads_started":1}
I20260808 05:55:15.900327 11001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:15.899863 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:56857)
0808 05:55:15.900110 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:15.900189 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":63,"threads_started":1}
I20260808 05:55:15.901907 11002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:15.901476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:50157)
0808 05:55:15.901749 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:15.901815 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":86,"threads_started":1}
I20260808 05:55:15.990463 11003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:15.990682 11003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } }
I20260808 05:55:15.991223 11003 leader_election.cc:288] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447), 3ba5eece9c114c62b0e5f637884b95e8 (127.2.191.125:37423)
I20260808 05:55:15.991842 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:15.991391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50878)
0808 05:55:15.991652 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:15.991739 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":75,"threads_started":1}
I20260808 05:55:15.991835 10216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "393e63224dd444b2a71eea7176a3b754" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3ba5eece9c114c62b0e5f637884b95e8" is_pre_election: true
I20260808 05:55:15.992009 10216 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 393e63224dd444b2a71eea7176a3b754 in term 2.
I20260808 05:55:15.992443 10395 leader_election.cc:302] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 393e63224dd444b2a71eea7176a3b754, 3ba5eece9c114c62b0e5f637884b95e8; no voters:
I20260808 05:55:15.992635 11003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260808 05:55:15.992708 11003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:15.992792 11003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 2 FOLLOWER]: Advancing to term 3
I20260808 05:55:15.993060 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:15.992817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50888)
0808 05:55:15.992945 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:15.992998 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 05:55:15.993206 10394 leader_election.cc:334] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447): Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:15.994175 11003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } }
I20260808 05:55:15.994536 11003 leader_election.cc:288] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 3 election: Requested vote from peers eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447), 3ba5eece9c114c62b0e5f637884b95e8 (127.2.191.125:37423)
I20260808 05:55:15.994916 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:15.994639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50892)
0808 05:55:15.994743 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:15.994809 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:55:15.994952 10216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "393e63224dd444b2a71eea7176a3b754" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3ba5eece9c114c62b0e5f637884b95e8"
I20260808 05:55:15.995121 10216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 2 FOLLOWER]: Advancing to term 3
I20260808 05:55:15.996106 10216 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 393e63224dd444b2a71eea7176a3b754 in term 3.
I20260808 05:55:15.996461 10395 leader_election.cc:302] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 393e63224dd444b2a71eea7176a3b754, 3ba5eece9c114c62b0e5f637884b95e8; no voters:
I20260808 05:55:15.996659 11003 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 05:55:15.996953 11003 raft_consensus.cc:686] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [term 3 LEADER]: Becoming Leader. State: Replica: 393e63224dd444b2a71eea7176a3b754, State: Running, Role: LEADER
I20260808 05:55:15.996982 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:15.996784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50908)
0808 05:55:15.996882 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:15.996929 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 05:55:15.997095 10394 leader_election.cc:334] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447): Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
I20260808 05:55:15.997289 11003 consensus_queue.cc:237] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } }
I20260808 05:55:15.998517 11007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 393e63224dd444b2a71eea7176a3b754. Latest consensus state: current_term: 3 leader_uuid: "393e63224dd444b2a71eea7176a3b754" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:15.998643 11007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:16.401396 10216 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [term 3 FOLLOWER]: Refusing update from remote peer 393e63224dd444b2a71eea7176a3b754: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 13. (index mismatch)
I20260808 05:55:16.401979 11007 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 05:55:16.403318 11013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 393e63224dd444b2a71eea7176a3b754. Latest consensus state: current_term: 3 leader_uuid: "393e63224dd444b2a71eea7176a3b754" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:16.403465 11013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:55:16.405043 11003 sys_catalog.cc:455] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "393e63224dd444b2a71eea7176a3b754" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:16.405193 11003 sys_catalog.cc:458] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:16.405532 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.405232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50948)
0808 05:55:16.405368 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.405438 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 05:55:16.405718 11013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "393e63224dd444b2a71eea7176a3b754" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "eba2996fd09d42aa8bd020146491a69d" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36447 } } peers { permanent_uuid: "3ba5eece9c114c62b0e5f637884b95e8" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 37423 } attrs { promote: false } } peers { permanent_uuid: "393e63224dd444b2a71eea7176a3b754" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 38871 } attrs { promote: false } } }
I20260808 05:55:16.405843 11013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ba5eece9c114c62b0e5f637884b95e8 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:55:16.406262 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.406073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.0.0.1:50952)
0808 05:55:16.406160 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.406209 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 05:55:16.406389 10394 consensus_peers.cc:487] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754 -> Peer eba2996fd09d42aa8bd020146491a69d (127.2.191.126:36447): Couldn't send request to peer eba2996fd09d42aa8bd020146491a69d. Status: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 05:55:16.412170 11011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:16.414979 11011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:16.415400 11011 catalog_manager.cc:1259] Loaded cluster ID: 6403146fce1047268fe96d5cdc56e645
I20260808 05:55:16.415450 11011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:16.416033 11011 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:16.416442 11011 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Loaded TSK: 0
I20260808 05:55:16.417239 11011 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:55:16.496300 10404 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44074:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:16.499775 10404 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:16.517359 11004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.512311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:43757 (local address 127.0.0.1:42622)
0808 05:55:16.512482 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.512501 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:16.512597 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:16.513096 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:16.513100 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:16.513120 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:16.513284 (+ 164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:16.513292 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.514683 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.514686 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:16.515905 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:16.515916 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.516908 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.516912 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:16.517017 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:16.517060 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 05:55:16.517114 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:55:16.517202 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":26}
I20260808 05:55:16.517791 11022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.513294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39411 (local address 127.0.0.1:55868)
0808 05:55:16.513797 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.513814 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:16.513958 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:16.514468 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:16.514471 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:16.514489 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:16.514582 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:16.514590 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.515350 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.515356 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:16.516315 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:16.516326 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.517371 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.517377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:16.517473 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:16.517498 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 05:55:16.517579 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 05:55:16.517658 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":389,"mutex_wait_us":26,"thread_start_us":93,"threads_started":1}
I20260808 05:55:16.518000 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.512477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42622 (local address 127.2.191.67:43757)
0808 05:55:16.512854 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:16.512859 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:16.512875 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:55:16.512929 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:16.512932 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:16.512985 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:16.513083 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:16.513446 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.514553 (+ 1107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.516054 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.516760 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.517659 (+ 899us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:16.517738 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:16.517777 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 05:55:16.517865 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":112,"threads_started":1}
I20260808 05:55:16.518208 11025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.513423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55868 (local address 127.2.191.65:39411)
0808 05:55:16.514025 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:16.514030 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:16.514045 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:55:16.514288 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:16.514295 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:16.514349 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:16.514446 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:16.514731 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.515228 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.516461 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.517137 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.517242 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:16.517312 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:16.517950 (+ 638us) server_negotiation.cc:299] Negotiation successful
0808 05:55:16.518046 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":71,"threads_started":1}
I20260808 05:55:16.518673 11023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.513255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39998 (local address 127.2.191.66:40141)
0808 05:55:16.513521 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:16.513526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:16.513854 (+ 328us) server_negotiation.cc:407] Connection header received
0808 05:55:16.513925 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:16.513930 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:16.513980 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:16.514070 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:16.514506 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.515312 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.516697 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.517356 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.517422 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:16.517533 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:16.517955 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 05:55:16.518046 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":77,"threads_started":1}
I20260808 05:55:16.518702 10838 tablet_service.cc:1467] Processing CreateTablet for tablet c100bb09db1a4c778c3c7d0198a8bf0a (DEFAULT_TABLE table=test-table [id=396fa64679c947259d6f3abf67dadf31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:16.518836 10537 tablet_service.cc:1467] Processing CreateTablet for tablet c100bb09db1a4c778c3c7d0198a8bf0a (DEFAULT_TABLE table=test-table [id=396fa64679c947259d6f3abf67dadf31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:16.519043 10838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c100bb09db1a4c778c3c7d0198a8bf0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:16.519090 10537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c100bb09db1a4c778c3c7d0198a8bf0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:16.519138 11024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.512963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:40141 (local address 127.0.0.1:39998)
0808 05:55:16.513653 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.513699 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:16.513808 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:16.514213 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:16.514216 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:16.514238 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:16.514332 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:16.514339 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.515470 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.515482 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:16.516551 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:16.516564 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.517680 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.517683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:16.517786 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:16.517806 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 05:55:16.518906 (+ 1100us) client_negotiation.cc:240] Negotiation successful
0808 05:55:16.518994 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"mutex_wait_us":23,"thread_start_us":106,"threads_started":1}
I20260808 05:55:16.521293 10690 tablet_service.cc:1467] Processing CreateTablet for tablet c100bb09db1a4c778c3c7d0198a8bf0a (DEFAULT_TABLE table=test-table [id=396fa64679c947259d6f3abf67dadf31]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:16.521639 10690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c100bb09db1a4c778c3c7d0198a8bf0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:16.521785 11026 tablet_bootstrap.cc:492] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: Bootstrap starting.
I20260808 05:55:16.522806 11026 tablet_bootstrap.cc:654] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:16.523569 11027 tablet_bootstrap.cc:492] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1: Bootstrap starting.
I20260808 05:55:16.524277 11026 tablet_bootstrap.cc:492] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: No bootstrap required, opened a new log
I20260808 05:55:16.524369 11026 ts_tablet_manager.cc:1397] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:16.524581 11027 tablet_bootstrap.cc:654] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:16.524883 11026 raft_consensus.cc:348] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.525015 11026 raft_consensus.cc:374] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:16.525061 11026 raft_consensus.cc:729] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ee95ab20a744f07be295b65a58f6e27, State: Initialized, Role: FOLLOWER
I20260808 05:55:16.525205 11026 consensus_queue.cc:260] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.525301 11029 tablet_bootstrap.cc:492] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: Bootstrap starting.
I20260808 05:55:16.525571 11026 ts_tablet_manager.cc:1428] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 05:55:16.526014 11027 tablet_bootstrap.cc:492] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1: No bootstrap required, opened a new log
I20260808 05:55:16.526121 11027 ts_tablet_manager.cc:1397] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:16.526582 11027 raft_consensus.cc:348] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.526722 11027 raft_consensus.cc:374] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:16.526758 11027 raft_consensus.cc:729] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96fe63e894c34b0d9829bc70894764c1, State: Initialized, Role: FOLLOWER
I20260808 05:55:16.526930 11027 consensus_queue.cc:260] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.527307 11027 ts_tablet_manager.cc:1428] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 05:55:16.528452 10912 heartbeater.cc:503] Master 127.2.191.124:38871 was elected leader, sending a full tablet report...
I20260808 05:55:16.528795 11029 tablet_bootstrap.cc:654] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:16.530687 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.530275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:34345)
0808 05:55:16.530521 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.530578 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":108,"threads_started":1}
I20260808 05:55:16.531942 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.531564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:35051)
0808 05:55:16.531795 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.531872 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
I20260808 05:55:16.532300 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.526062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:60947)
0808 05:55:16.526553 (+ 491us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.532190 (+ 5637us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":142,"threads_started":1}
I20260808 05:55:16.533008 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.532795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:32847)
0808 05:55:16.532897 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.532947 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 05:55:16.533304 11029 tablet_bootstrap.cc:492] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: No bootstrap required, opened a new log
I20260808 05:55:16.533401 11029 ts_tablet_manager.cc:1397] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260808 05:55:16.533865 11029 raft_consensus.cc:348] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.534008 11029 raft_consensus.cc:374] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:16.534042 11029 raft_consensus.cc:729] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e952373d5cd410187fbdc3aaa5723fb, State: Initialized, Role: FOLLOWER
I20260808 05:55:16.534211 11029 consensus_queue.cc:260] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.534766 11029 ts_tablet_manager.cc:1428] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 05:55:16.536401 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.535204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:59053)
0808 05:55:16.536199 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.536275 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":124,"threads_started":1}
I20260808 05:55:16.536487 10763 heartbeater.cc:503] Master 127.2.191.124:38871 was elected leader, sending a full tablet report...
I20260808 05:55:16.537236 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.536953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:34837)
0808 05:55:16.537085 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.537142 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260808 05:55:16.551316 11033 raft_consensus.cc:482] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:16.551438 11033 raft_consensus.cc:504] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.551927 11033 leader_election.cc:288] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757), 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141)
I20260808 05:55:16.552347 10713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c100bb09db1a4c778c3c7d0198a8bf0a" candidate_uuid: "96fe63e894c34b0d9829bc70894764c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e952373d5cd410187fbdc3aaa5723fb" is_pre_election: true
I20260808 05:55:16.552356 10862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c100bb09db1a4c778c3c7d0198a8bf0a" candidate_uuid: "96fe63e894c34b0d9829bc70894764c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ee95ab20a744f07be295b65a58f6e27" is_pre_election: true
I20260808 05:55:16.552486 10713 raft_consensus.cc:2454] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96fe63e894c34b0d9829bc70894764c1 in term 0.
I20260808 05:55:16.552527 10862 raft_consensus.cc:2454] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96fe63e894c34b0d9829bc70894764c1 in term 0.
I20260808 05:55:16.552918 10487 leader_election.cc:302] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e952373d5cd410187fbdc3aaa5723fb, 96fe63e894c34b0d9829bc70894764c1; no voters:
I20260808 05:55:16.553130 11033 raft_consensus.cc:2781] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:16.553205 11033 raft_consensus.cc:482] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:16.553259 11033 raft_consensus.cc:3037] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:16.554520 11033 raft_consensus.cc:504] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.554908 11033 leader_election.cc:288] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [CANDIDATE]: Term 1 election: Requested vote from peers 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757), 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141)
I20260808 05:55:16.555312 10862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c100bb09db1a4c778c3c7d0198a8bf0a" candidate_uuid: "96fe63e894c34b0d9829bc70894764c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ee95ab20a744f07be295b65a58f6e27"
I20260808 05:55:16.555318 10713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c100bb09db1a4c778c3c7d0198a8bf0a" candidate_uuid: "96fe63e894c34b0d9829bc70894764c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e952373d5cd410187fbdc3aaa5723fb"
I20260808 05:55:16.555462 10713 raft_consensus.cc:3037] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:16.555433 10862 raft_consensus.cc:3037] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:16.556463 10713 raft_consensus.cc:2454] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96fe63e894c34b0d9829bc70894764c1 in term 1.
I20260808 05:55:16.556514 10862 raft_consensus.cc:2454] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96fe63e894c34b0d9829bc70894764c1 in term 1.
I20260808 05:55:16.556813 10487 leader_election.cc:302] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e952373d5cd410187fbdc3aaa5723fb, 96fe63e894c34b0d9829bc70894764c1; no voters:
I20260808 05:55:16.557013 11033 raft_consensus.cc:2781] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:16.557286 11033 raft_consensus.cc:686] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 1 LEADER]: Becoming Leader. State: Replica: 96fe63e894c34b0d9829bc70894764c1, State: Running, Role: LEADER
I20260808 05:55:16.557458 11033 consensus_queue.cc:237] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } }
I20260808 05:55:16.557531 10612 heartbeater.cc:503] Master 127.2.191.124:38871 was elected leader, sending a full tablet report...
I20260808 05:55:16.558113 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.557841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:39209)
0808 05:55:16.557960 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.558028 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:55:16.559334 10402 catalog_manager.cc:5495] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 96fe63e894c34b0d9829bc70894764c1 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "96fe63e894c34b0d9829bc70894764c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96fe63e894c34b0d9829bc70894764c1" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 } health_report { overall_health: UNKNOWN } } }
I20260808 05:55:16.581769 11025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.578716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55878 (local address 127.2.191.65:39411)
0808 05:55:16.578863 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:16.578867 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:16.578883 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:55:16.578973 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:16.578977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:16.579031 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:16.579126 (+ 95us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:16.579383 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.579907 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.580704 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:16.580979 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:16.581063 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:16.581292 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:16.581362 (+ 70us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:16.581417 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:16.581524 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:55:16.581573 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 05:55:16.584010 10862 raft_consensus.cc:1261] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 1 FOLLOWER]: Refusing update from remote peer 96fe63e894c34b0d9829bc70894764c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:16.584007 10713 raft_consensus.cc:1261] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 1 FOLLOWER]: Refusing update from remote peer 96fe63e894c34b0d9829bc70894764c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:16.584568 11040 consensus_queue.cc:1035] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e952373d5cd410187fbdc3aaa5723fb" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:16.584833 11033 consensus_queue.cc:1035] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ee95ab20a744f07be295b65a58f6e27" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:16.586697 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.586362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:42173)
0808 05:55:16.586532 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.586596 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 05:55:16.589953 11044 mvcc.cc:205] Tried to move back new op lower bound from 7316146243923750912 to 7316146243821133824. Current Snapshot: MvccSnapshot[applied={T|T < 7316146243923750912}]
I20260808 05:55:16.590950 11035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.590295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.65:43143)
0808 05:55:16.590794 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.590863 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418}
I20260808 05:55:16.593070 11032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.592702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.67:35827)
0808 05:55:16.592935 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.592993 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162}
I20260808 05:55:16.594197 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.586496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:50563)
0808 05:55:16.594023 (+ 7527us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.594116 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":7452}
I20260808 05:55:16.595112 11038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.594746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36447 (local address 127.2.191.66:53123)
0808 05:55:16.594884 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.594944 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:36447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260808 05:55:16.595114 10402 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:16.595290 10402 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44074:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:16.599031 10402 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 393e63224dd444b2a71eea7176a3b754: Sending DeleteTablet for 3 replicas of tablet c100bb09db1a4c778c3c7d0198a8bf0a
I20260808 05:55:16.600215 10838 tablet_service.cc:1514] Processing DeleteTablet for tablet c100bb09db1a4c778c3c7d0198a8bf0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:16 UTC) from {username='oryx', principal='oryx/127.2.191.124@KRBTEST.COM'} at 127.0.0.1:42622
I20260808 05:55:16.600195 10690 tablet_service.cc:1514] Processing DeleteTablet for tablet c100bb09db1a4c778c3c7d0198a8bf0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:16 UTC) from {username='oryx', principal='oryx/127.2.191.124@KRBTEST.COM'} at 127.0.0.1:39998
I20260808 05:55:16.600267 10537 tablet_service.cc:1514] Processing DeleteTablet for tablet c100bb09db1a4c778c3c7d0198a8bf0a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:16 UTC) from {username='oryx', principal='oryx/127.2.191.124@KRBTEST.COM'} at 127.0.0.1:55868
I20260808 05:55:16.600616 11053 tablet_replica.cc:330] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: stopping tablet replica
I20260808 05:55:16.600634 11054 tablet_replica.cc:330] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1: stopping tablet replica
I20260808 05:55:16.600801 11054 raft_consensus.cc:2229] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:55:16.600911 11052 tablet_replica.cc:330] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: stopping tablet replica
I20260808 05:55:16.601032 11054 raft_consensus.cc:2258] T c100bb09db1a4c778c3c7d0198a8bf0a P 96fe63e894c34b0d9829bc70894764c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:16.601050 11052 raft_consensus.cc:2229] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:16.601181 11052 raft_consensus.cc:2258] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:16.601320 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 10365
I20260808 05:55:16.603955 11053 raft_consensus.cc:2229] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:16.604146 11053 raft_consensus.cc:2258] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:16.605188 11052 ts_tablet_manager.cc:1905] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:16.608439 11052 ts_tablet_manager.cc:1918] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:16.608536 11052 log.cc:1196] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/c100bb09db1a4c778c3c7d0198a8bf0a
I20260808 05:55:16.608860 11052 ts_tablet_manager.cc:1939] T c100bb09db1a4c778c3c7d0198a8bf0a P 4ee95ab20a744f07be295b65a58f6e27: Deleting consensus metadata
I20260808 05:55:16.609316 11053 ts_tablet_manager.cc:1905] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:16.610172 10393 catalog_manager.cc:4841] TS 4ee95ab20a744f07be295b65a58f6e27 (127.2.191.67:43757): tablet c100bb09db1a4c778c3c7d0198a8bf0a (table test-table [id=396fa64679c947259d6f3abf67dadf31]) successfully deleted
I20260808 05:55:16.611694 11053 ts_tablet_manager.cc:1918] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:16.611832 11053 log.cc:1196] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/c100bb09db1a4c778c3c7d0198a8bf0a
I20260808 05:55:16.612151 11053 ts_tablet_manager.cc:1939] T c100bb09db1a4c778c3c7d0198a8bf0a P 8e952373d5cd410187fbdc3aaa5723fb: Deleting consensus metadata
I20260808 05:55:16.612890 10395 catalog_manager.cc:4841] TS 8e952373d5cd410187fbdc3aaa5723fb (127.2.191.66:40141): tablet c100bb09db1a4c778c3c7d0198a8bf0a (table test-table [id=396fa64679c947259d6f3abf67dadf31]) successfully deleted
I20260808 05:55:16.615417 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 10620
I20260808 05:55:16.615530 11024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:16.615190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39411 (local address 127.0.0.1:55890)
0808 05:55:16.615352 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:16.615416 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:39411: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 05:55:16.617214 10394 catalog_manager.cc:4584] TS 96fe63e894c34b0d9829bc70894764c1 (127.2.191.65:39411): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c100bb09db1a4c778c3c7d0198a8bf0a: Network error: Client connection negotiation failed: client connection to 127.2.191.65:39411: connect: Connection refused (error 111)
I20260808 05:55:16.623112 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 10772
I20260808 05:55:16.632905 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 10058
I20260808 05:55:16.641294 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 10175
2026-08-08T05:55:16Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7772 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:55:16 dist-test-slave-qg60 krb5kdc[11058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:55:16 dist-test-slave-qg60 krb5kdc[11058](info): set up 2 sockets
Aug 08 05:55:16 dist-test-slave-qg60 krb5kdc[11058](info): commencing operation
krb5kdc: starting...
W20260808 05:55:17.781877 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:17 dist-test-slave-qg60 krb5kdc[11058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:17Z Disabled control of system clock
WARNING: no policy specified for oryx/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.126.keytab.
Entry for principal oryx/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.126.keytab.
I20260808 05:55:17.915431 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33567
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.126.keytab
--principal=oryx/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:42263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:33567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:18.032295 11071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:18.032634 11071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:18.032712 11071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:18.036856 11071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:18.036966 11071 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:55:18.036998 11071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:18.037041 11071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:18.037111 11071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:18.037153 11071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:18.042766 11071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:42263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:33567
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.126.keytab
--principal=oryx/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11071
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:18.043946 11071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:18.045069 11071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:55:18.054847 11071 server_base.cc:1034] running on GCE node
W20260808 05:55:18.054955 11076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:18.054857 11079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:18.054951 11077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:18.056128 11071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:18.057415 11071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:18.058596 11071 hybrid_clock.cc:648] HybridClock initialized: now 1786168518058555 us; error 57 us; skew 500 ppm
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:18.066655 11071 init.cc:377] Logged in from keytab as oryx/127.2.191.126@KRBTEST.COM (short username oryx)
I20260808 05:55:18.067772 11071 webserver.cc:460] Webserver started at http://127.2.191.126:39397/ using document root <none> and password file <none>
I20260808 05:55:18.068399 11071 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:18.068503 11071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:18.068842 11071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:18.071017 11071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "67b42f3d651141b49e8e5edbc03e3601"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "bbfa3fb36e5d5739bb017a27c759d30b"
server_key_iv: "dfda281a8ae580b551b9321720be573e"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.071630 11071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "67b42f3d651141b49e8e5edbc03e3601"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "bbfa3fb36e5d5739bb017a27c759d30b"
server_key_iv: "dfda281a8ae580b551b9321720be573e"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.075703 11071 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:55:18.078570 11088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:18.079871 11071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:55:18.080029 11071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "67b42f3d651141b49e8e5edbc03e3601"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "bbfa3fb36e5d5739bb017a27c759d30b"
server_key_iv: "dfda281a8ae580b551b9321720be573e"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.080157 11071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:18.095664 11071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:18.098974 11071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:18.099212 11071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:18.108029 11071 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:33567
I20260808 05:55:18.108067 11155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:33567 every 8 connection(s)
I20260808 05:55:18.109131 11071 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:18.111877 11156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:18.113368 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 11071
I20260808 05:55:18.113504 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:18.113855 2813 external_mini_cluster.cc:1428] Setting key 91d0159944777d13912b500ded73f921
I20260808 05:55:18.118119 11156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: Bootstrap starting.
I20260808 05:55:18.120350 11156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:18.121206 11156 log.cc:824] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: Log is configured to *not* fsync() on all Append() calls
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168517, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:18.123540 11156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: No bootstrap required, opened a new log
I20260808 05:55:18.126840 11156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b42f3d651141b49e8e5edbc03e3601" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33567 } }
I20260808 05:55:18.127071 11156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:18.127156 11156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67b42f3d651141b49e8e5edbc03e3601, State: Initialized, Role: FOLLOWER
I20260808 05:55:18.127672 11156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b42f3d651141b49e8e5edbc03e3601" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33567 } }
I20260808 05:55:18.127843 11156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:18.127925 11156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:18.128031 11156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:18.129277 11156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b42f3d651141b49e8e5edbc03e3601" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33567 } }
I20260808 05:55:18.129645 11156 leader_election.cc:302] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67b42f3d651141b49e8e5edbc03e3601; no voters:
I20260808 05:55:18.129843 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.115392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.2.191.126:33567)
0808 05:55:18.115844 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.115858 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.115896 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:55:18.116535 (+ 639us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.116563 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.116962 (+ 399us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.117293 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.118123 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.119158 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.120010 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.120509 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.120699 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.123833 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:18.123838 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:18.123851 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:18.123878 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:18.126261 (+ 2383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.126749 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.126754 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.126758 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.126873 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.127255 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.127258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.127260 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.127779 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:18.128003 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.128412 (+ 409us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.128717 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":133,"threads_started":1}
I20260808 05:55:18.129977 11156 leader_election.cc:288] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:18.130333 11163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:18.130686 11163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [term 1 LEADER]: Becoming Leader. State: Replica: 67b42f3d651141b49e8e5edbc03e3601, State: Running, Role: LEADER
I20260808 05:55:18.131057 11163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b42f3d651141b49e8e5edbc03e3601" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33567 } }
I20260808 05:55:18.131269 11156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:18.133246 11164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67b42f3d651141b49e8e5edbc03e3601" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b42f3d651141b49e8e5edbc03e3601" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33567 } } }
I20260808 05:55:18.133460 11164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:18.133782 11165 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67b42f3d651141b49e8e5edbc03e3601. Latest consensus state: current_term: 1 leader_uuid: "67b42f3d651141b49e8e5edbc03e3601" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67b42f3d651141b49e8e5edbc03e3601" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33567 } } }
I20260808 05:55:18.134022 11178 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:18.134225 11165 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:18.136861 11178 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:18.142216 11178 catalog_manager.cc:1347] Generated new cluster ID: 4f4e5983f5e24a52b17a58536464f32d
I20260808 05:55:18.142292 11178 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:18.151054 11178 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:18.152397 11178 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:18.172783 11178 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: Generated new TSK 0
I20260808 05:55:18.173612 11178 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab.
Entry for principal oryx/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab.
I20260808 05:55:18.207476 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33567
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab
--principal=oryx/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:42263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:18.325199 11187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:18.325461 11187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:18.325510 11187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:18.329463 11187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:18.329517 11187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:18.329556 11187 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:55:18.329589 11187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:18.336072 11187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:42263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab
--principal=oryx/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:33567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:18.337271 11187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:18.338347 11187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:55:18.348690 11187 server_base.cc:1034] running on GCE node
W20260808 05:55:18.348608 11194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:18.348587 11196 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:18.348587 11193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:18.349339 11187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:18.350008 11187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:18.351229 11187 hybrid_clock.cc:648] HybridClock initialized: now 1786168518351198 us; error 46 us; skew 500 ppm
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:18.354249 11187 init.cc:377] Logged in from keytab as oryx/127.2.191.65@KRBTEST.COM (short username oryx)
I20260808 05:55:18.355141 11187 webserver.cc:460] Webserver started at http://127.2.191.65:41377/ using document root <none> and password file <none>
I20260808 05:55:18.355671 11187 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:18.355731 11187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:18.355901 11187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:18.357990 11187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "ef7fc14da7824785a00a23e8ea256519"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "fb778a6237ee25fa4acee9460247e364"
server_key_iv: "507cb103dee37e1faad8916f75f9f94b"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.358515 11187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "ef7fc14da7824785a00a23e8ea256519"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "fb778a6237ee25fa4acee9460247e364"
server_key_iv: "507cb103dee37e1faad8916f75f9f94b"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.362725 11187 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:55:18.365314 11204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:18.366688 11187 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:18.366823 11187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "ef7fc14da7824785a00a23e8ea256519"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "fb778a6237ee25fa4acee9460247e364"
server_key_iv: "507cb103dee37e1faad8916f75f9f94b"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.366948 11187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:18.380198 11187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:18.383737 11187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:18.383953 11187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:18.385629 11187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:18.385680 11187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:18.385720 11187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:18.385775 11187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:18.397769 11187 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:34301
I20260808 05:55:18.397845 11336 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:34301 every 8 connection(s)
I20260808 05:55:18.398825 11187 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:18.401655 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.386562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:35655 (local address 127.2.191.126:33567)
0808 05:55:18.386703 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.386707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.387867 (+ 1160us) server_negotiation.cc:407] Connection header received
0808 05:55:18.389201 (+ 1334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.389205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.389274 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.389338 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.390974 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.391851 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.393884 (+ 2033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.394236 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.394344 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.397624 (+ 3280us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:18.397627 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:18.397629 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:18.397656 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:18.399385 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.400089 (+ 704us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.400093 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.400095 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.400198 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.400543 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.400545 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.400546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.400771 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:18.400861 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.401416 (+ 555us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.401531 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:55:18.402516 11215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.387133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33567 (local address 127.2.191.65:35655)
0808 05:55:18.387702 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.387761 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.388909 (+ 1148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.389758 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.389765 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.390161 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:18.390807 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.390822 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.392019 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.392024 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.393687 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.393702 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.394428 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.394435 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.394709 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.395584 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:18.395622 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:18.397398 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:18.399519 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.399525 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.399540 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.399929 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.400302 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.400305 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.400306 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.400446 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.400868 (+ 422us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:18.400873 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:18.401173 (+ 300us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.401334 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.401596 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":155,"threads_started":1}
I20260808 05:55:18.403883 11337 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33567
I20260808 05:55:18.404033 11337 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:18.404649 11337 heartbeater.cc:511] Master 127.2.191.126:33567 requested a full tablet report, sending...
I20260808 05:55:18.405220 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 11187
I20260808 05:55:18.405370 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:18.405730 2813 external_mini_cluster.cc:1428] Setting key d15da0481dc40fd060e4c36c286dc94e
I20260808 05:55:18.406495 11106 ts_manager.cc:194] Registered new tserver with Master: ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301)
I20260808 05:55:18.408102 11106 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:35655
I20260808 05:55:18.415226 11344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.406641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33567 (local address 127.2.191.65:53099)
0808 05:55:18.407182 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.407203 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.407315 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.407620 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.407623 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.407840 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:18.407942 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.407948 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.408844 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.408848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.409755 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.409771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.410357 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.410363 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.410492 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.411040 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:18.411062 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:18.411596 (+ 534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:18.413702 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.413704 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.413706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.413901 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.414246 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.414248 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.414249 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.414354 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.414793 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:18.414795 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:18.414863 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.414941 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.415047 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":417,"mutex_wait_us":3,"thread_start_us":118,"threads_started":1}
I20260808 05:55:18.415388 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.406633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:53099 (local address 127.2.191.126:33567)
0808 05:55:18.406750 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.406754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.407286 (+ 532us) server_negotiation.cc:407] Connection header received
0808 05:55:18.407442 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.407445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.407507 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.407601 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.408073 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.408635 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.409898 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.410216 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.410331 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.411743 (+ 1412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:18.411746 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:18.411748 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:18.411775 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:18.413582 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.414013 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.414018 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.414020 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.414130 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.414481 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.414484 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.414486 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.414668 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:18.414729 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.415055 (+ 326us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.415193 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
WARNING: no policy specified for oryx/127.2.191.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab.
Entry for principal oryx/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab.
I20260808 05:55:18.440519 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33567
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab
--principal=oryx/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:42263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:18.560460 11347 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:18.560809 11347 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:18.560902 11347 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:18.565104 11347 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:18.565187 11347 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:18.565253 11347 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:55:18.565336 11347 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:18.570923 11347 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:42263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab
--principal=oryx/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:33567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11347
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:18.572080 11347 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:18.573190 11347 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:55:18.583244 11347 server_base.cc:1034] running on GCE node
W20260808 05:55:18.583181 11355 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:18.583216 11353 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:18.583204 11352 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:18.583938 11347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:18.584645 11347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:18.585850 11347 hybrid_clock.cc:648] HybridClock initialized: now 1786168518585821 us; error 67 us; skew 500 ppm
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:18.589066 11347 init.cc:377] Logged in from keytab as oryx/127.2.191.66@KRBTEST.COM (short username oryx)
I20260808 05:55:18.589955 11347 webserver.cc:460] Webserver started at http://127.2.191.66:42455/ using document root <none> and password file <none>
I20260808 05:55:18.590512 11347 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:18.590574 11347 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:18.590752 11347 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:18.592962 11347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "baad0d448b804ac5a3b69b759e466118"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "a6d324d70dd9f29049739caec50435de"
server_key_iv: "5623698962d80101816e2d451ad99d41"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.593509 11347 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "baad0d448b804ac5a3b69b759e466118"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "a6d324d70dd9f29049739caec50435de"
server_key_iv: "5623698962d80101816e2d451ad99d41"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.597730 11347 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 05:55:18.600255 11363 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:18.601553 11347 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:18.601673 11347 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "baad0d448b804ac5a3b69b759e466118"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "a6d324d70dd9f29049739caec50435de"
server_key_iv: "5623698962d80101816e2d451ad99d41"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.601766 11347 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:18.614040 11347 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:18.617254 11347 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:18.617421 11347 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:18.618945 11347 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:18.619029 11347 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:18.619097 11347 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:18.619149 11347 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:18.630856 11347 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:39973
I20260808 05:55:18.630923 11493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:39973 every 8 connection(s)
I20260808 05:55:18.632155 11347 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:18.634815 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.620013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:42841 (local address 127.2.191.126:33567)
0808 05:55:18.620161 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.620166 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.621354 (+ 1188us) server_negotiation.cc:407] Connection header received
0808 05:55:18.622627 (+ 1273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.622631 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.622696 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.622805 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.624539 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.625491 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.627047 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.627478 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.627610 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.630674 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:18.630679 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:18.630682 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:18.630718 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:18.632539 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.633284 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.633289 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.633291 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.633392 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.633706 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.633708 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.633709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.633886 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:18.633962 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.634576 (+ 614us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.634693 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 05:55:18.635676 11374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.620625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33567 (local address 127.2.191.66:42841)
0808 05:55:18.621186 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.621233 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.622320 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.623008 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.623018 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.623562 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:18.624289 (+ 727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.624313 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.625662 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.625666 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.626933 (+ 1267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.626944 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.627664 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.627667 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.627807 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.628455 (+ 648us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:18.628495 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:18.630479 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:18.632697 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.632722 (+ 25us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.632759 (+ 37us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.633146 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.633500 (+ 354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.633502 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.633503 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.633639 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.633996 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:18.634002 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:18.634308 (+ 306us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.634482 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.634752 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":147,"threads_started":1}
I20260808 05:55:18.636960 11494 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33567
I20260808 05:55:18.637135 11494 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:18.637723 11494 heartbeater.cc:511] Master 127.2.191.126:33567 requested a full tablet report, sending...
I20260808 05:55:18.638371 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 11347
I20260808 05:55:18.638502 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:18.638809 11107 ts_manager.cc:194] Registered new tserver with Master: baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973)
I20260808 05:55:18.638836 2813 external_mini_cluster.cc:1428] Setting key 8cf90efd27f3d8ba6359b684ef2e1ff4
I20260808 05:55:18.639580 11107 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:42841
I20260808 05:55:18.647985 11501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.639525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33567 (local address 127.2.191.66:41945)
0808 05:55:18.640039 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.640057 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.640161 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.640473 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.640476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.640764 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:18.640883 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.640890 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.641999 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.642001 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.642761 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.642775 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.643230 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.643235 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.643354 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.643928 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:18.643962 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:18.644321 (+ 359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:18.646399 (+ 2078us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.646401 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.646403 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.646616 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.646933 (+ 317us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.646935 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.646936 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.647008 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.647546 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:18.647548 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:18.647638 (+ 90us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.647719 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.647829 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":133,"threads_started":1}
I20260808 05:55:18.648138 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.639317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:41945 (local address 127.2.191.126:33567)
0808 05:55:18.639426 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.639430 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.640123 (+ 693us) server_negotiation.cc:407] Connection header received
0808 05:55:18.640297 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.640300 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.640351 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.640442 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.641013 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.641862 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.642892 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.643104 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.643193 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.644471 (+ 1278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:18.644477 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:18.644483 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:18.644517 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:18.646271 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.646720 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.646726 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.646729 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.646830 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.647102 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.647105 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.647109 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.647446 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:18.647569 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.647819 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.647951 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
WARNING: no policy specified for oryx/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab.
Entry for principal oryx/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab.
I20260808 05:55:18.671389 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33567
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab
--principal=oryx/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:42263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:18.790586 11504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:18.790901 11504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:18.791011 11504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:18.795135 11504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:18.795233 11504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:18.795331 11504 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:55:18.795409 11504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:18.801399 11504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:42263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab
--principal=oryx/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.2.191.126:33567
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:18.802557 11504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:18.803623 11504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:55:18.813951 11504 server_base.cc:1034] running on GCE node
W20260808 05:55:18.813966 11509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:18.813966 11510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:18.814139 11512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:18.814544 11504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:18.815246 11504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:18.816481 11504 hybrid_clock.cc:648] HybridClock initialized: now 1786168518816448 us; error 50 us; skew 500 ppm
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:18.819373 11504 init.cc:377] Logged in from keytab as oryx/127.2.191.67@KRBTEST.COM (short username oryx)
I20260808 05:55:18.820312 11504 webserver.cc:460] Webserver started at http://127.2.191.67:42017/ using document root <none> and password file <none>
I20260808 05:55:18.820968 11504 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:18.821064 11504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:18.821313 11504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:18.823468 11504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "65f9bc0934ca4d81b79f4701d992b950"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "908a642ffea9368702ba7a9454454460"
server_key_iv: "89982d49784659a29499a5c8fa50060c"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.824040 11504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "65f9bc0934ca4d81b79f4701d992b950"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "908a642ffea9368702ba7a9454454460"
server_key_iv: "89982d49784659a29499a5c8fa50060c"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.828073 11504 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.001s
I20260808 05:55:18.830719 11519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:18.832124 11504 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:55:18.832275 11504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "65f9bc0934ca4d81b79f4701d992b950"
format_stamp: "Formatted at 2026-08-08 05:55:18 on dist-test-slave-qg60"
server_key: "908a642ffea9368702ba7a9454454460"
server_key_iv: "89982d49784659a29499a5c8fa50060c"
server_key_version: "encryptionkey@0"
I20260808 05:55:18.832394 11504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:18.848276 11504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:18.851979 11504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:18.852221 11504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:18.853905 11504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:18.853984 11504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:18.854081 11504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:18.854135 11504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:18.865850 11504 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:38927
I20260808 05:55:18.865916 11647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:38927 every 8 connection(s)
I20260808 05:55:18.867008 11504 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:18.869190 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 11504
I20260808 05:55:18.869335 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:18.869704 2813 external_mini_cluster.cc:1428] Setting key baa04e05d4831cad289050be7e6f6e4a
I20260808 05:55:18.870024 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.854609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:37509 (local address 127.2.191.126:33567)
0808 05:55:18.854762 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.854766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.855792 (+ 1026us) server_negotiation.cc:407] Connection header received
0808 05:55:18.857150 (+ 1358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.857157 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.857231 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.857301 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.859307 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.860001 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.861953 (+ 1952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.862328 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.862428 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.865705 (+ 3277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:18.865709 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:18.865712 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:18.865743 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:18.867571 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.868231 (+ 660us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.868234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.868235 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.868320 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.868650 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.868652 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.868653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.868914 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:18.869008 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.869715 (+ 707us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.869879 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:55:18.871124 11529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.855093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33567 (local address 127.2.191.67:37509)
0808 05:55:18.855598 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.855669 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.856858 (+ 1189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.857808 (+ 950us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.857820 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.858330 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:18.859118 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.859142 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.860124 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.860131 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.861799 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.861814 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.862497 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.862502 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.862723 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.863439 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:18.863468 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:18.865455 (+ 1987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:18.867718 (+ 2263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.867724 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.867738 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.868106 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.868410 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.868413 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.868414 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.868550 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.869095 (+ 545us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:18.869101 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:18.869432 (+ 331us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.869651 (+ 219us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.870016 (+ 365us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":110,"threads_started":1}
I20260808 05:55:18.872303 11648 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33567
I20260808 05:55:18.872475 11648 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:18.873077 11648 heartbeater.cc:511] Master 127.2.191.126:33567 requested a full tablet report, sending...
I20260808 05:55:18.874078 11106 ts_manager.cc:194] Registered new tserver with Master: 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927)
I20260808 05:55:18.874747 11106 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:37509
I20260808 05:55:18.881604 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.874421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:42089 (local address 127.2.191.126:33567)
0808 05:55:18.875070 (+ 649us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.875074 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.875089 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:55:18.875125 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.875127 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.875173 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.875235 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.875768 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.876425 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.877389 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.877618 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.877728 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.878785 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:18.878789 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:18.878792 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:18.878822 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:18.879959 (+ 1137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.880376 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.880380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.880382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.880469 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.880766 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.880770 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.880772 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.880948 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:18.881059 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.881319 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.881454 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577}
I20260808 05:55:18.881623 11655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.874366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33567 (local address 127.2.191.67:42089)
0808 05:55:18.874646 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.874667 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.874736 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.875301 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.875304 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.875536 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:18.875640 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.875645 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.876603 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.876610 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.877260 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.877269 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.877734 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.877737 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.877830 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.878323 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:18.878335 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:18.878650 (+ 315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:18.880071 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.880075 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.880078 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.880275 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.880563 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:18.880567 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:18.880569 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:18.880654 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:18.881049 (+ 395us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:18.881052 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:18.881151 (+ 99us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.881262 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.881433 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":116,"threads_started":1}
I20260808 05:55:18.883846 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:55:18.909547 11160 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:18.902776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53294 (local address 127.2.191.126:33567)
0808 05:55:18.902933 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.902938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.902954 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:55:18.903004 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.903007 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.903056 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.903151 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.903852 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.904474 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.905585 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.905805 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.905897 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.909361 (+ 3464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53294: BlockingRecv error: recv got EOF from 127.0.0.1:53294 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 05:55:18 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:18.919543 11160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.911032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53304 (local address 127.2.191.126:33567)
0808 05:55:18.911176 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.911179 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.911314 (+ 135us) server_negotiation.cc:407] Connection header received
0808 05:55:18.911411 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.911413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.911451 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.911522 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:18.912125 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.912612 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.913485 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.913694 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.913778 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.916183 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:18.916186 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:18.916188 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:18.916213 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:18.917778 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.918230 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.918234 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.918236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.918322 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:18.918613 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:18.918639 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:18.918642 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:18.918836 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:18.918986 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.919242 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.919365 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:55:18.922806 11106 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53304:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:18.925989 11106 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:18.941426 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.936198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50934 (local address 127.2.191.65:34301)
0808 05:55:18.936946 (+ 748us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.936953 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.936974 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:55:18.937042 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.937046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.937319 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.937712 (+ 393us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:18.937820 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.938559 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.940059 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.940727 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.940856 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.941007 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.941183 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.941283 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":110,"threads_started":1}
I20260808 05:55:18.941429 11674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.935298 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:34301 (local address 127.0.0.1:50934)
0808 05:55:18.936481 (+ 1183us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.936494 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.936576 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.937466 (+ 890us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.937469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.937483 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:18.937566 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.937574 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.938702 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.938706 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.939927 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.939937 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.940857 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.940861 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.940976 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.941021 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.941139 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.941261 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1121,"mutex_wait_us":116,"thread_start_us":89,"threads_started":1}
I20260808 05:55:18.942042 11671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.934965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:39973 (local address 127.0.0.1:59698)
0808 05:55:18.935734 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.935790 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.935933 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.937333 (+ 1400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.937336 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.937353 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:18.937506 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.937513 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.938850 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.938853 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.940425 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.940436 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.941615 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.941619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.941714 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.941741 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.941810 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.941881 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":558,"mutex_wait_us":200,"thread_start_us":71,"threads_started":1}
I20260808 05:55:18.942550 11675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.935804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51742 (local address 127.2.191.67:38927)
0808 05:55:18.936372 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.936384 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.936448 (+ 64us) server_negotiation.cc:407] Connection header received
0808 05:55:18.936546 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.936552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.936791 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.936968 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:18.937424 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.938664 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.940565 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.941425 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.941549 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.941730 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.942325 (+ 595us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.942417 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":446,"thread_start_us":120,"threads_started":1}
I20260808 05:55:18.942229 11672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.935064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:38927 (local address 127.0.0.1:51742)
0808 05:55:18.935880 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:18.935896 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:18.936035 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:18.936969 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:18.936976 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:18.937000 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:18.937222 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.937232 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.938807 (+ 1575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.938810 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.940425 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:18.940436 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.941794 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.941798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:18.941923 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.941950 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 05:55:18.942025 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:55:18.942097 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":734,"mutex_wait_us":169,"thread_start_us":129,"threads_started":1}
I20260808 05:55:18.943032 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:18.935127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59698 (local address 127.2.191.66:39973)
0808 05:55:18.936863 (+ 1736us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:18.936872 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:18.936910 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:55:18.936992 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:18.936997 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:18.937187 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:18.937350 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:18.937624 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.938719 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.940577 (+ 1858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:18.941452 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:18.942562 (+ 1110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:18.942737 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:18.942788 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 05:55:18.942876 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1568,"thread_start_us":131,"threads_started":1}
I20260808 05:55:18.945024 11262 tablet_service.cc:1467] Processing CreateTablet for tablet 23d70631cbf44ed8bd0195eb514ea826 (DEFAULT_TABLE table=test-table [id=8243199bef864cb59cae11d5411260db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:18.945577 11576 tablet_service.cc:1467] Processing CreateTablet for tablet 23d70631cbf44ed8bd0195eb514ea826 (DEFAULT_TABLE table=test-table [id=8243199bef864cb59cae11d5411260db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:18.945827 11422 tablet_service.cc:1467] Processing CreateTablet for tablet 23d70631cbf44ed8bd0195eb514ea826 (DEFAULT_TABLE table=test-table [id=8243199bef864cb59cae11d5411260db]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:18.946291 11262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d70631cbf44ed8bd0195eb514ea826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:18.946606 11576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d70631cbf44ed8bd0195eb514ea826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:18.946762 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23d70631cbf44ed8bd0195eb514ea826. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:18.953485 11677 tablet_bootstrap.cc:492] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Bootstrap starting.
I20260808 05:55:18.954612 11680 tablet_bootstrap.cc:492] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Bootstrap starting.
I20260808 05:55:18.955451 11678 tablet_bootstrap.cc:492] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Bootstrap starting.
I20260808 05:55:18.956437 11677 tablet_bootstrap.cc:654] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:18.956554 11680 tablet_bootstrap.cc:654] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:18.957324 11680 log.cc:824] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:18.957355 11677 log.cc:824] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:18.957552 11678 tablet_bootstrap.cc:654] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:18.958351 11678 log.cc:824] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:18.959318 11677 tablet_bootstrap.cc:492] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: No bootstrap required, opened a new log
I20260808 05:55:18.959527 11677 ts_tablet_manager.cc:1397] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:55:18.960002 11678 tablet_bootstrap.cc:492] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: No bootstrap required, opened a new log
I20260808 05:55:18.960192 11678 ts_tablet_manager.cc:1397] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260808 05:55:18.961447 11680 tablet_bootstrap.cc:492] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: No bootstrap required, opened a new log
I20260808 05:55:18.961678 11680 ts_tablet_manager.cc:1397] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 05:55:18.963076 11677 raft_consensus.cc:348] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:18.963320 11677 raft_consensus.cc:374] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:18.963397 11677 raft_consensus.cc:729] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baad0d448b804ac5a3b69b759e466118, State: Initialized, Role: FOLLOWER
I20260808 05:55:18.963862 11677 consensus_queue.cc:260] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:18.964570 11494 heartbeater.cc:503] Master 127.2.191.126:33567 was elected leader, sending a full tablet report...
I20260808 05:55:18.964916 11677 ts_tablet_manager.cc:1428] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s
I20260808 05:55:18.965533 11680 raft_consensus.cc:348] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:18.965827 11680 raft_consensus.cc:374] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:18.965902 11680 raft_consensus.cc:729] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f9bc0934ca4d81b79f4701d992b950, State: Initialized, Role: FOLLOWER
I20260808 05:55:18.965979 11678 raft_consensus.cc:348] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:18.966267 11678 raft_consensus.cc:374] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:18.966323 11678 raft_consensus.cc:729] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc14da7824785a00a23e8ea256519, State: Initialized, Role: FOLLOWER
I20260808 05:55:18.966349 11680 consensus_queue.cc:260] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:18.966768 11678 consensus_queue.cc:260] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:18.967039 11648 heartbeater.cc:503] Master 127.2.191.126:33567 was elected leader, sending a full tablet report...
I20260808 05:55:18.967394 11680 ts_tablet_manager.cc:1428] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:55:18.967687 11678 ts_tablet_manager.cc:1428] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 05:55:18.967990 11337 heartbeater.cc:503] Master 127.2.191.126:33567 was elected leader, sending a full tablet report...
W20260808 05:55:19.118121 11649 tablet.cc:2369] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:55:19.133581 11495 tablet.cc:2369] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:55:19.150535 11338 tablet.cc:2369] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:55:19.213490 11684 raft_consensus.cc:482] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:19.213780 11684 raft_consensus.cc:504] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:19.215026 11684 leader_election.cc:288] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927), ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301)
I20260808 05:55:19.220124 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.215479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:51699 (local address 127.2.191.65:34301)
0808 05:55:19.215615 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.215632 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.215877 (+ 245us) server_negotiation.cc:407] Connection header received
0808 05:55:19.216069 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.216072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.216126 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.216208 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:19.216580 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.217320 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.218739 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.219374 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.219505 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.219560 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.219914 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.219987 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:55:19.220125 11675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.215426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:43781 (local address 127.2.191.67:38927)
0808 05:55:19.215628 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.215634 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.215741 (+ 107us) server_negotiation.cc:407] Connection header received
0808 05:55:19.215919 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.215927 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.215969 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.216048 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:19.216366 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.217175 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.218739 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.219374 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.219505 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.219560 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.219914 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.219987 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130}
I20260808 05:55:19.220175 11687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.215292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:38927 (local address 127.2.191.66:43781)
0808 05:55:19.215626 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:19.215643 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:19.215798 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:19.216069 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:19.216072 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:19.216089 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:19.216221 (+ 132us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.216231 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.217290 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.217293 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.218607 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.218618 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.219547 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.219551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.219739 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.219794 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 05:55:19.219885 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 05:55:19.219987 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"mutex_wait_us":69,"thread_start_us":107,"threads_started":1}
I20260808 05:55:19.220175 11688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.215425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:34301 (local address 127.2.191.66:51699)
0808 05:55:19.215778 (+ 353us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:19.215789 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:19.215916 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:19.216307 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:19.216309 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:19.216350 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:19.216460 (+ 110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.216465 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.217450 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.217453 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.218607 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.218618 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.219547 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.219551 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.219768 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.219806 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 05:55:19.219885 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:55:19.219987 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":294,"mutex_wait_us":119,"thread_start_us":90,"threads_started":1}
I20260808 05:55:19.221000 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d70631cbf44ed8bd0195eb514ea826" candidate_uuid: "baad0d448b804ac5a3b69b759e466118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f9bc0934ca4d81b79f4701d992b950" is_pre_election: true
I20260808 05:55:19.221001 11284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d70631cbf44ed8bd0195eb514ea826" candidate_uuid: "baad0d448b804ac5a3b69b759e466118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc14da7824785a00a23e8ea256519" is_pre_election: true
I20260808 05:55:19.221345 11284 raft_consensus.cc:2454] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baad0d448b804ac5a3b69b759e466118 in term 0.
I20260808 05:55:19.221345 11597 raft_consensus.cc:2454] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baad0d448b804ac5a3b69b759e466118 in term 0.
I20260808 05:55:19.221848 11364 leader_election.cc:302] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baad0d448b804ac5a3b69b759e466118, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:19.222169 11684 raft_consensus.cc:2781] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:19.222271 11684 raft_consensus.cc:482] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:19.222335 11684 raft_consensus.cc:3037] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.223415 11684 raft_consensus.cc:504] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:19.223835 11684 leader_election.cc:288] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [CANDIDATE]: Term 1 election: Requested vote from peers 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927), ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301)
I20260808 05:55:19.224242 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d70631cbf44ed8bd0195eb514ea826" candidate_uuid: "baad0d448b804ac5a3b69b759e466118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f9bc0934ca4d81b79f4701d992b950"
I20260808 05:55:19.224277 11284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23d70631cbf44ed8bd0195eb514ea826" candidate_uuid: "baad0d448b804ac5a3b69b759e466118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc14da7824785a00a23e8ea256519"
I20260808 05:55:19.224396 11597 raft_consensus.cc:3037] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.224423 11284 raft_consensus.cc:3037] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.225553 11284 raft_consensus.cc:2454] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baad0d448b804ac5a3b69b759e466118 in term 1.
I20260808 05:55:19.225891 11364 leader_election.cc:302] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baad0d448b804ac5a3b69b759e466118, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:19.225970 11597 raft_consensus.cc:2454] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baad0d448b804ac5a3b69b759e466118 in term 1.
I20260808 05:55:19.226075 11684 raft_consensus.cc:2781] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:19.226317 11684 raft_consensus.cc:686] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 1 LEADER]: Becoming Leader. State: Replica: baad0d448b804ac5a3b69b759e466118, State: Running, Role: LEADER
I20260808 05:55:19.226675 11684 consensus_queue.cc:237] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } }
I20260808 05:55:19.229879 11104 catalog_manager.cc:5495] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 reported cstate change: term changed from 0 to 1, leader changed from <none> to baad0d448b804ac5a3b69b759e466118 (127.2.191.66). New cstate: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } health_report { overall_health: UNKNOWN } } }
I20260808 05:55:19.311537 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.307728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59710 (local address 127.2.191.66:39973)
0808 05:55:19.307877 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.307883 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.307910 (+ 27us) server_negotiation.cc:407] Connection header received
0808 05:55:19.308003 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.308005 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.308058 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.308179 (+ 121us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:19.308432 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.309002 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.309976 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.310205 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.310352 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.310658 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:19.311123 (+ 465us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:19.311250 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.311317 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.311376 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 05:55:19.317890 11597 raft_consensus.cc:1261] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Refusing update from remote peer baad0d448b804ac5a3b69b759e466118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:19.317890 11284 raft_consensus.cc:1261] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Refusing update from remote peer baad0d448b804ac5a3b69b759e466118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:19.318715 11691 consensus_queue.cc:1035] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:19.319012 11684 consensus_queue.cc:1035] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:19.326009 11694 mvcc.cc:205] Tried to move back new op lower bound from 7316146255117271040 to 7316146254755262464. Current Snapshot: MvccSnapshot[applied={T|T < 7316146255117271040}]
I20260808 05:55:19.326762 11695 mvcc.cc:205] Tried to move back new op lower bound from 7316146255117271040 to 7316146254755262464. Current Snapshot: MvccSnapshot[applied={T|T < 7316146255117271040}]
I20260808 05:55:19.335742 11104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:19.335961 11104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:19.338846 11104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: Sending DeleteTablet for 3 replicas of tablet 23d70631cbf44ed8bd0195eb514ea826
I20260808 05:55:19.339723 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d70631cbf44ed8bd0195eb514ea826 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:19 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:59698
I20260808 05:55:19.339794 11262 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d70631cbf44ed8bd0195eb514ea826 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:19 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:50934
I20260808 05:55:19.339824 11576 tablet_service.cc:1514] Processing DeleteTablet for tablet 23d70631cbf44ed8bd0195eb514ea826 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:19 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:51742
I20260808 05:55:19.340318 11703 tablet_replica.cc:330] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: stopping tablet replica
I20260808 05:55:19.340360 11706 tablet_replica.cc:330] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: stopping tablet replica
I20260808 05:55:19.340783 11703 raft_consensus.cc:2229] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:19.340792 11706 raft_consensus.cc:2229] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:55:19.341194 11706 raft_consensus.cc:2258] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:19.341259 11703 raft_consensus.cc:2258] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:19.341333 11107 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53304:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:19.341823 11107 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:19.343155 11703 ts_tablet_manager.cc:1905] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:19.343155 11706 ts_tablet_manager.cc:1905] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:19.343779 11704 tablet_replica.cc:330] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: stopping tablet replica
I20260808 05:55:19.344152 11704 raft_consensus.cc:2229] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:19.344528 11704 raft_consensus.cc:2258] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:19.346266 11706 ts_tablet_manager.cc:1918] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:19.346415 11706 log.cc:1196] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/23d70631cbf44ed8bd0195eb514ea826
I20260808 05:55:19.346817 11706 ts_tablet_manager.cc:1939] T 23d70631cbf44ed8bd0195eb514ea826 P baad0d448b804ac5a3b69b759e466118: Deleting consensus metadata
I20260808 05:55:19.348357 11262 tablet_service.cc:1467] Processing CreateTablet for tablet b89827070c9b4e57bcb37e9b8812c691 (DEFAULT_TABLE table=test-table [id=427d5f501d774d78be7982050625c334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:19.348666 11262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b89827070c9b4e57bcb37e9b8812c691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.350385 11703 ts_tablet_manager.cc:1918] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:19.350528 11703 log.cc:1196] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/23d70631cbf44ed8bd0195eb514ea826
I20260808 05:55:19.350780 11678 tablet_bootstrap.cc:492] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: Bootstrap starting.
I20260808 05:55:19.350886 11703 ts_tablet_manager.cc:1939] T 23d70631cbf44ed8bd0195eb514ea826 P 65f9bc0934ca4d81b79f4701d992b950: Deleting consensus metadata
I20260808 05:55:19.351009 11576 tablet_service.cc:1467] Processing CreateTablet for tablet b89827070c9b4e57bcb37e9b8812c691 (DEFAULT_TABLE table=test-table [id=427d5f501d774d78be7982050625c334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:19.351341 11576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b89827070c9b4e57bcb37e9b8812c691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.351688 11091 catalog_manager.cc:4841] TS baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973): tablet 23d70631cbf44ed8bd0195eb514ea826 (table test-table [id=8243199bef864cb59cae11d5411260db]) successfully deleted
I20260808 05:55:19.351892 11678 tablet_bootstrap.cc:654] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.352494 11422 tablet_service.cc:1467] Processing CreateTablet for tablet b89827070c9b4e57bcb37e9b8812c691 (DEFAULT_TABLE table=test-table [id=427d5f501d774d78be7982050625c334]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:19.352805 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b89827070c9b4e57bcb37e9b8812c691. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.353464 11678 tablet_bootstrap.cc:492] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: No bootstrap required, opened a new log
I20260808 05:55:19.353551 11678 ts_tablet_manager.cc:1397] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:19.353756 11680 tablet_bootstrap.cc:492] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: Bootstrap starting.
I20260808 05:55:19.354064 11678 raft_consensus.cc:348] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.354178 11678 raft_consensus.cc:374] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.354214 11678 raft_consensus.cc:729] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc14da7824785a00a23e8ea256519, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.354344 11678 consensus_queue.cc:260] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.354605 11678 ts_tablet_manager.cc:1428] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:19.354830 11680 tablet_bootstrap.cc:654] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.355283 11677 tablet_bootstrap.cc:492] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: Bootstrap starting.
I20260808 05:55:19.356280 11677 tablet_bootstrap.cc:654] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.356608 11092 catalog_manager.cc:4841] TS 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927): tablet 23d70631cbf44ed8bd0195eb514ea826 (table test-table [id=8243199bef864cb59cae11d5411260db]) successfully deleted
I20260808 05:55:19.357748 11677 tablet_bootstrap.cc:492] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: No bootstrap required, opened a new log
I20260808 05:55:19.357846 11677 ts_tablet_manager.cc:1397] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:19.358314 11677 raft_consensus.cc:348] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.358443 11677 raft_consensus.cc:374] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.358489 11677 raft_consensus.cc:729] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baad0d448b804ac5a3b69b759e466118, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.358628 11677 consensus_queue.cc:260] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.358897 11677 ts_tablet_manager.cc:1428] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:19.359688 11704 ts_tablet_manager.cc:1905] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:19.361601 11680 tablet_bootstrap.cc:492] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: No bootstrap required, opened a new log
I20260808 05:55:19.361711 11680 ts_tablet_manager.cc:1397] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260808 05:55:19.362237 11680 raft_consensus.cc:348] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.362370 11680 raft_consensus.cc:374] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.362404 11680 raft_consensus.cc:729] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f9bc0934ca4d81b79f4701d992b950, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.362550 11680 consensus_queue.cc:260] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.362828 11680 ts_tablet_manager.cc:1428] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 05:55:19.362989 11704 ts_tablet_manager.cc:1918] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:19.363099 11704 log.cc:1196] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/23d70631cbf44ed8bd0195eb514ea826
I20260808 05:55:19.363447 11704 ts_tablet_manager.cc:1939] T 23d70631cbf44ed8bd0195eb514ea826 P ef7fc14da7824785a00a23e8ea256519: Deleting consensus metadata
I20260808 05:55:19.364915 11089 catalog_manager.cc:4841] TS ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301): tablet 23d70631cbf44ed8bd0195eb514ea826 (table test-table [id=8243199bef864cb59cae11d5411260db]) successfully deleted
I20260808 05:55:19.528843 11685 raft_consensus.cc:482] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:19.529034 11685 raft_consensus.cc:504] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.530150 11685 leader_election.cc:288] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301), baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973)
I20260808 05:55:19.535790 11676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.530639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:53425 (local address 127.2.191.65:34301)
0808 05:55:19.530763 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.530767 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.530832 (+ 65us) server_negotiation.cc:407] Connection header received
0808 05:55:19.531042 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.531046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.531100 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.531192 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:19.531663 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.532500 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.534432 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.535028 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.535168 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.535225 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.535574 (+ 349us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.535662 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 05:55:19.535790 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.530541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:50809 (local address 127.2.191.66:39973)
0808 05:55:19.530756 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.530762 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.530871 (+ 109us) server_negotiation.cc:407] Connection header received
0808 05:55:19.531042 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.531046 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.531108 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.531192 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:19.531718 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.532500 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.534431 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.535028 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.535189 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.535234 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.535574 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.535655 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260808 05:55:19.535836 11711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.530434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:34301 (local address 127.2.191.67:53425)
0808 05:55:19.530745 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:19.530763 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:19.530895 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:19.531220 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:19.531223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:19.531265 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:19.531518 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.531523 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.532629 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.532633 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.534301 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.534313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.535159 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.535162 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.535348 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.535463 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 05:55:19.535544 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 05:55:19.535674 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"mutex_wait_us":299,"spinlock_wait_cycles":4608,"thread_start_us":86,"threads_started":1}
I20260808 05:55:19.535846 11712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.530406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:39973 (local address 127.2.191.67:50809)
0808 05:55:19.530745 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:19.530806 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:19.530929 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:19.531220 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:19.531223 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:19.531264 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:19.531514 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.531522 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.532631 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.532633 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.534301 (+ 1668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.534313 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.535168 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.535171 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.535346 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.535463 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 05:55:19.535544 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 05:55:19.535674 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":395,"spinlock_wait_cycles":30976,"thread_start_us":101,"threads_started":1}
I20260808 05:55:19.536469 11284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b89827070c9b4e57bcb37e9b8812c691" candidate_uuid: "65f9bc0934ca4d81b79f4701d992b950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc14da7824785a00a23e8ea256519" is_pre_election: true
I20260808 05:55:19.536545 11442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b89827070c9b4e57bcb37e9b8812c691" candidate_uuid: "65f9bc0934ca4d81b79f4701d992b950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baad0d448b804ac5a3b69b759e466118" is_pre_election: true
I20260808 05:55:19.536695 11284 raft_consensus.cc:2454] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65f9bc0934ca4d81b79f4701d992b950 in term 0.
I20260808 05:55:19.536814 11442 raft_consensus.cc:2454] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65f9bc0934ca4d81b79f4701d992b950 in term 0.
I20260808 05:55:19.537159 11521 leader_election.cc:302] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f9bc0934ca4d81b79f4701d992b950, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:19.537438 11685 raft_consensus.cc:2781] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:19.537508 11685 raft_consensus.cc:482] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:19.537546 11685 raft_consensus.cc:3037] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.538642 11685 raft_consensus.cc:504] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.538959 11685 leader_election.cc:288] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301), baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973)
I20260808 05:55:19.539299 11442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b89827070c9b4e57bcb37e9b8812c691" candidate_uuid: "65f9bc0934ca4d81b79f4701d992b950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baad0d448b804ac5a3b69b759e466118"
I20260808 05:55:19.539273 11284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b89827070c9b4e57bcb37e9b8812c691" candidate_uuid: "65f9bc0934ca4d81b79f4701d992b950" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc14da7824785a00a23e8ea256519"
I20260808 05:55:19.539394 11442 raft_consensus.cc:3037] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.539408 11284 raft_consensus.cc:3037] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.540277 11442 raft_consensus.cc:2454] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65f9bc0934ca4d81b79f4701d992b950 in term 1.
I20260808 05:55:19.540315 11284 raft_consensus.cc:2454] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65f9bc0934ca4d81b79f4701d992b950 in term 1.
I20260808 05:55:19.540558 11523 leader_election.cc:302] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f9bc0934ca4d81b79f4701d992b950, baad0d448b804ac5a3b69b759e466118; no voters:
I20260808 05:55:19.540841 11685 raft_consensus.cc:2781] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:19.540990 11685 raft_consensus.cc:686] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 LEADER]: Becoming Leader. State: Replica: 65f9bc0934ca4d81b79f4701d992b950, State: Running, Role: LEADER
I20260808 05:55:19.541255 11685 consensus_queue.cc:237] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.543514 11107 catalog_manager.cc:5495] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67). New cstate: current_term: 1 leader_uuid: "65f9bc0934ca4d81b79f4701d992b950" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } health_report { overall_health: HEALTHY } } }
Aug 08 05:55:19 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168518, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.126@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:19.579736 11721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.570689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33567 (local address 127.0.0.1:53318)
0808 05:55:19.571068 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:19.571083 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:19.571184 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:19.571467 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:19.571469 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:19.572011 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:19.572115 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.572122 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.573019 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.573021 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.573587 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.573595 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.574042 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.574045 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.574111 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.574668 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:19.574680 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:19.576202 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:19.578095 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:19.578105 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:19.578112 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:19.578355 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:19.578642 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:19.578645 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:19.578647 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:19.578737 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:19.579123 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:19.579132 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:19.579249 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 05:55:19.579365 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 05:55:19.579532 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":162,"threads_started":1}
I20260808 05:55:19.579736 11722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.570804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53318 (local address 127.2.191.126:33567)
0808 05:55:19.571106 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.571121 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.571136 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:55:19.571275 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.571277 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.571320 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.571435 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:19.572255 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.572895 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.573705 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.573935 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.574016 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.576350 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:19.576353 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:19.576355 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:19.576375 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:19.577964 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:19.578457 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:19.578462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:19.578463 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:19.578545 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:19.578830 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:19.578833 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:19.578835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:19.579015 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:19.579122 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.579422 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.579601 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":65,"server-negotiator.queue_time_us":226,"thread_start_us":118,"threads_started":1}
I20260808 05:55:19.584112 11107 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:53318:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:55:19.584964 11107 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:19.589965 11422 tablet_service.cc:1467] Processing CreateTablet for tablet 0b632540b6f64a3cb02f3e387d1de68c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c98b8316613e4395b940d7362f828638]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:55:19.589967 11262 tablet_service.cc:1467] Processing CreateTablet for tablet 0b632540b6f64a3cb02f3e387d1de68c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c98b8316613e4395b940d7362f828638]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:55:19.590404 11262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b632540b6f64a3cb02f3e387d1de68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.590404 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b632540b6f64a3cb02f3e387d1de68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.590278 11576 tablet_service.cc:1467] Processing CreateTablet for tablet 0b632540b6f64a3cb02f3e387d1de68c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=c98b8316613e4395b940d7362f828638]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:55:19.590689 11576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0b632540b6f64a3cb02f3e387d1de68c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.593312 11680 tablet_bootstrap.cc:492] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: Bootstrap starting.
I20260808 05:55:19.593358 11678 tablet_bootstrap.cc:492] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: Bootstrap starting.
I20260808 05:55:19.594169 11680 tablet_bootstrap.cc:654] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.594269 11678 tablet_bootstrap.cc:654] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.595280 11677 tablet_bootstrap.cc:492] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: Bootstrap starting.
I20260808 05:55:19.595427 11680 tablet_bootstrap.cc:492] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: No bootstrap required, opened a new log
I20260808 05:55:19.595520 11680 ts_tablet_manager.cc:1397] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:55:19.595590 11678 tablet_bootstrap.cc:492] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: No bootstrap required, opened a new log
I20260808 05:55:19.595679 11678 ts_tablet_manager.cc:1397] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:55:19.595978 11680 raft_consensus.cc:348] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.596110 11680 raft_consensus.cc:374] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.596154 11680 raft_consensus.cc:729] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f9bc0934ca4d81b79f4701d992b950, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.596184 11677 tablet_bootstrap.cc:654] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.596124 11678 raft_consensus.cc:348] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.596249 11678 raft_consensus.cc:374] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.596297 11678 raft_consensus.cc:729] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc14da7824785a00a23e8ea256519, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.596297 11680 consensus_queue.cc:260] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.596432 11678 consensus_queue.cc:260] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.596598 11680 ts_tablet_manager.cc:1428] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:19.596773 11678 ts_tablet_manager.cc:1428] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s
I20260808 05:55:19.596839 11685 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.596982 11685 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:55:19.597004 11686 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.597142 11686 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:55:19.597987 11677 tablet_bootstrap.cc:492] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: No bootstrap required, opened a new log
I20260808 05:55:19.598107 11677 ts_tablet_manager.cc:1397] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 05:55:19.598589 11677 raft_consensus.cc:348] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.598709 11677 raft_consensus.cc:374] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.598745 11677 raft_consensus.cc:729] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baad0d448b804ac5a3b69b759e466118, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.598891 11677 consensus_queue.cc:260] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.599172 11677 ts_tablet_manager.cc:1428] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:19.599376 11684 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.599502 11684 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:55:19.715902 11684 raft_consensus.cc:482] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:19.716048 11684 raft_consensus.cc:504] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.716583 11684 leader_election.cc:288] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301), 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927)
I20260808 05:55:19.717151 11284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b632540b6f64a3cb02f3e387d1de68c" candidate_uuid: "baad0d448b804ac5a3b69b759e466118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc14da7824785a00a23e8ea256519" is_pre_election: true
I20260808 05:55:19.717200 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b632540b6f64a3cb02f3e387d1de68c" candidate_uuid: "baad0d448b804ac5a3b69b759e466118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f9bc0934ca4d81b79f4701d992b950" is_pre_election: true
I20260808 05:55:19.717294 11284 raft_consensus.cc:2454] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baad0d448b804ac5a3b69b759e466118 in term 0.
I20260808 05:55:19.717397 11597 raft_consensus.cc:2454] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate baad0d448b804ac5a3b69b759e466118 in term 0.
I20260808 05:55:19.717708 11364 leader_election.cc:302] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baad0d448b804ac5a3b69b759e466118, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:19.717911 11684 raft_consensus.cc:2781] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:19.717974 11684 raft_consensus.cc:482] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:19.718003 11684 raft_consensus.cc:3037] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.719106 11684 raft_consensus.cc:504] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.719499 11684 leader_election.cc:288] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [CANDIDATE]: Term 1 election: Requested vote from peers ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301), 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927)
I20260808 05:55:19.719857 11284 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b632540b6f64a3cb02f3e387d1de68c" candidate_uuid: "baad0d448b804ac5a3b69b759e466118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef7fc14da7824785a00a23e8ea256519"
I20260808 05:55:19.719956 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0b632540b6f64a3cb02f3e387d1de68c" candidate_uuid: "baad0d448b804ac5a3b69b759e466118" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f9bc0934ca4d81b79f4701d992b950"
I20260808 05:55:19.720005 11284 raft_consensus.cc:3037] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.720096 11597 raft_consensus.cc:3037] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:19.721153 11284 raft_consensus.cc:2454] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baad0d448b804ac5a3b69b759e466118 in term 1.
I20260808 05:55:19.721312 11597 raft_consensus.cc:2454] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate baad0d448b804ac5a3b69b759e466118 in term 1.
I20260808 05:55:19.721458 11364 leader_election.cc:302] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baad0d448b804ac5a3b69b759e466118, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:19.721642 11684 raft_consensus.cc:2781] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:19.721757 11684 raft_consensus.cc:686] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [term 1 LEADER]: Becoming Leader. State: Replica: baad0d448b804ac5a3b69b759e466118, State: Running, Role: LEADER
I20260808 05:55:19.721897 11684 consensus_queue.cc:237] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.722563 11691 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: TxnStatusTablet state changed. Reason: New leader baad0d448b804ac5a3b69b759e466118. Latest consensus state: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.722690 11691 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:55:19.722925 11727 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:55:19.723090 11727 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:55:19.723666 11106 catalog_manager.cc:5495] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 reported cstate change: term changed from 0 to 1, leader changed from <none> to baad0d448b804ac5a3b69b759e466118 (127.2.191.66). New cstate: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } health_report { overall_health: UNKNOWN } } }
I20260808 05:55:19.753201 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.749367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59726 (local address 127.2.191.66:39973)
0808 05:55:19.749494 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.749497 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.749541 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:55:19.749734 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.749737 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.749784 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.749850 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:19.750195 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.750824 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.752048 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.752274 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.752357 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.752684 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:19.752810 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:19.752867 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.753014 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.753066 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:55:19.753228 11721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.749225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:39973 (local address 127.0.0.1:59726)
0808 05:55:19.749480 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:19.749496 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:19.749609 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:19.749896 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:19.749899 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:19.749906 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:55:19.750045 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.750051 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.750936 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.750940 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.751918 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.751929 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.752384 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.752388 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.752494 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.752550 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:55:19.752892 (+ 342us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:55:19.752908 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 05:55:19.752984 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:55:19.753075 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150}
I20260808 05:55:19.756119 11597 raft_consensus.cc:1261] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Refusing update from remote peer baad0d448b804ac5a3b69b759e466118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:19.756182 11284 raft_consensus.cc:1261] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Refusing update from remote peer baad0d448b804ac5a3b69b759e466118: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:19.756749 11691 consensus_queue.cc:1035] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:19.756934 11684 consensus_queue.cc:1035] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:19.758354 11686 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: TxnStatusTablet state changed. Reason: New leader baad0d448b804ac5a3b69b759e466118. Latest consensus state: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.758472 11686 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:55:19.758615 11685 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: TxnStatusTablet state changed. Reason: New leader baad0d448b804ac5a3b69b759e466118. Latest consensus state: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.758716 11685 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:55:19.760025 11684 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.760149 11684 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:55:19.760442 11684 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.760519 11684 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P baad0d448b804ac5a3b69b759e466118: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:55:19.761533 11686 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.761632 11686 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P ef7fc14da7824785a00a23e8ea256519: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:55:19.765180 11685 tablet_replica.cc:439] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "baad0d448b804ac5a3b69b759e466118" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } } }
I20260808 05:55:19.765300 11685 tablet_replica.cc:442] T 0b632540b6f64a3cb02f3e387d1de68c P 65f9bc0934ca4d81b79f4701d992b950: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:55:19.772255 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.767993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51752 (local address 127.2.191.67:38927)
0808 05:55:19.768322 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.768328 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.768341 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:19.768407 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.768409 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.768458 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.768559 (+ 101us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:19.768835 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.769407 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.770587 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.770862 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.770943 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.771274 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:19.771780 (+ 506us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:19.771898 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.771981 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.772031 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":168,"threads_started":1}
I20260808 05:55:19.783358 11737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.779517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:39973 (local address 127.2.191.67:49919)
0808 05:55:19.779841 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:19.779855 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:19.779944 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:19.780191 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:19.780193 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:19.780199 (+ 6us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:55:19.780316 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.780320 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.781369 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.781372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.782002 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.782011 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.782660 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.782663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.782731 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.782775 (+ 44us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:55:19.783064 (+ 289us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:55:19.783068 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:55:19.783146 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:55:19.783234 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":127,"threads_started":1}
I20260808 05:55:19.783349 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.779629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:49919 (local address 127.2.191.66:39973)
0808 05:55:19.779762 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.779767 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.779932 (+ 165us) server_negotiation.cc:407] Connection header received
0808 05:55:19.780023 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.780026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.780084 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.780165 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:19.780421 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.781243 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.782171 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.782507 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.782611 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.782903 (+ 292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:19.782984 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:19.783054 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.783151 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.783207 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:55:19.790894 11284 raft_consensus.cc:1261] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Refusing update from remote peer 65f9bc0934ca4d81b79f4701d992b950: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:19.791199 11442 raft_consensus.cc:1261] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Refusing update from remote peer 65f9bc0934ca4d81b79f4701d992b950: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:19.791754 11713 consensus_queue.cc:1035] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:19.791960 11685 consensus_queue.cc:1035] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:19.815583 11743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.811800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:38927 (local address 127.2.191.66:59669)
0808 05:55:19.812151 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:19.812168 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:19.812275 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:19.812497 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:19.812501 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:19.812508 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:55:19.812617 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.812623 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.813496 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.813501 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.814390 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:19.814400 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.814847 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.814850 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:19.814936 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.814991 (+ 55us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:55:19.815300 (+ 309us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:55:19.815309 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 05:55:19.815374 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:55:19.815457 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":128,"threads_started":1}
I20260808 05:55:19.815577 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.811919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:59669 (local address 127.2.191.67:38927)
0808 05:55:19.812056 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.812060 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.812243 (+ 183us) server_negotiation.cc:407] Connection header received
0808 05:55:19.812366 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.812368 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.812410 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.812466 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:19.812707 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.813395 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.814514 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.814737 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.814848 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.815144 (+ 296us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:19.815217 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:19.815296 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.815384 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.815434 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:55:19.838553 11107 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:19.838748 11107 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53304:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:19.841099 11107 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: Sending DeleteTablet for 3 replicas of tablet b89827070c9b4e57bcb37e9b8812c691
I20260808 05:55:19.841804 11576 tablet_service.cc:1514] Processing DeleteTablet for tablet b89827070c9b4e57bcb37e9b8812c691 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:19 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:51742
I20260808 05:55:19.842016 11703 tablet_replica.cc:330] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: stopping tablet replica
I20260808 05:55:19.842227 11703 raft_consensus.cc:2229] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:55:19.842286 11262 tablet_service.cc:1514] Processing DeleteTablet for tablet b89827070c9b4e57bcb37e9b8812c691 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:19 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:50934
I20260808 05:55:19.842481 11704 tablet_replica.cc:330] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: stopping tablet replica
I20260808 05:55:19.842545 11703 raft_consensus.cc:2258] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:19.842584 11704 raft_consensus.cc:2229] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:19.842723 11704 raft_consensus.cc:2258] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:19.843072 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet b89827070c9b4e57bcb37e9b8812c691 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:19 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:59698
I20260808 05:55:19.843550 11704 ts_tablet_manager.cc:1905] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:19.843571 11703 ts_tablet_manager.cc:1905] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:19.847038 11703 ts_tablet_manager.cc:1918] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:55:19.847121 11703 log.cc:1196] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/b89827070c9b4e57bcb37e9b8812c691
I20260808 05:55:19.847169 11704 ts_tablet_manager.cc:1918] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:55:19.847295 11704 log.cc:1196] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/b89827070c9b4e57bcb37e9b8812c691
I20260808 05:55:19.847328 11706 tablet_replica.cc:330] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: stopping tablet replica
I20260808 05:55:19.847388 11703 ts_tablet_manager.cc:1939] T b89827070c9b4e57bcb37e9b8812c691 P 65f9bc0934ca4d81b79f4701d992b950: Deleting consensus metadata
I20260808 05:55:19.847527 11706 raft_consensus.cc:2229] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:19.847642 11704 ts_tablet_manager.cc:1939] T b89827070c9b4e57bcb37e9b8812c691 P ef7fc14da7824785a00a23e8ea256519: Deleting consensus metadata
I20260808 05:55:19.847702 11706 raft_consensus.cc:2258] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:19.848594 11089 catalog_manager.cc:4841] TS ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301): tablet b89827070c9b4e57bcb37e9b8812c691 (table test-table [id=427d5f501d774d78be7982050625c334]) successfully deleted
I20260808 05:55:19.848654 11706 ts_tablet_manager.cc:1905] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:19.849543 11092 catalog_manager.cc:4841] TS 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927): tablet b89827070c9b4e57bcb37e9b8812c691 (table test-table [id=427d5f501d774d78be7982050625c334]) successfully deleted
I20260808 05:55:19.852025 11706 ts_tablet_manager.cc:1918] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:55:19.852118 11706 log.cc:1196] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/b89827070c9b4e57bcb37e9b8812c691
I20260808 05:55:19.852445 11706 ts_tablet_manager.cc:1939] T b89827070c9b4e57bcb37e9b8812c691 P baad0d448b804ac5a3b69b759e466118: Deleting consensus metadata
I20260808 05:55:19.853245 11091 catalog_manager.cc:4841] TS baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973): tablet b89827070c9b4e57bcb37e9b8812c691 (table test-table [id=427d5f501d774d78be7982050625c334]) successfully deleted
Aug 08 05:55:19 dist-test-slave-qg60 krb5kdc[11058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168519, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:55:19 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:19 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:55:19.892071 11722 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:19.879535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53324 (local address 127.2.191.126:33567)
0808 05:55:19.879684 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.879689 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.880300 (+ 611us) server_negotiation.cc:407] Connection header received
0808 05:55:19.880498 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.880502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.880555 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.880659 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:19.881748 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.882615 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.883993 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.884365 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.884440 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.891931 (+ 7491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53324: BlockingRecv error: recv got EOF from 127.0.0.1:53324 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 08 05:55:19 dist-test-slave-qg60 krb5kdc[11058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168519, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM
I20260808 05:55:19.907099 11722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:19.895037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53338 (local address 127.2.191.126:33567)
0808 05:55:19.895161 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:19.895165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:19.895629 (+ 464us) server_negotiation.cc:407] Connection header received
0808 05:55:19.895821 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:19.895825 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:19.895873 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:19.895927 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:19.896844 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.897664 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.898897 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:19.899316 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:19.899448 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:19.902752 (+ 3304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:19.902757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:19.902760 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:19.902792 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:19.904666 (+ 1874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:19.905389 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:19.905394 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:19.905396 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:19.905496 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:19.905846 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:19.905850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:19.905852 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:19.906102 (+ 250us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:19.906240 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:19.906565 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 05:55:19.906703 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:55:19.910024 11107 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:19.910512 11107 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:19.915904 11262 tablet_service.cc:1467] Processing CreateTablet for tablet b373cffd90314735b4698b46e31b510c (DEFAULT_TABLE table=test-table [id=9652cca47fb74713b1318db76040eb3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:19.916091 11422 tablet_service.cc:1467] Processing CreateTablet for tablet b373cffd90314735b4698b46e31b510c (DEFAULT_TABLE table=test-table [id=9652cca47fb74713b1318db76040eb3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:19.916250 11262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b373cffd90314735b4698b46e31b510c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.916456 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b373cffd90314735b4698b46e31b510c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.918762 11678 tablet_bootstrap.cc:492] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: Bootstrap starting.
I20260808 05:55:19.919145 11677 tablet_bootstrap.cc:492] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: Bootstrap starting.
I20260808 05:55:19.919894 11678 tablet_bootstrap.cc:654] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.920024 11677 tablet_bootstrap.cc:654] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.920821 11576 tablet_service.cc:1467] Processing CreateTablet for tablet b373cffd90314735b4698b46e31b510c (DEFAULT_TABLE table=test-table [id=9652cca47fb74713b1318db76040eb3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:19.921167 11576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b373cffd90314735b4698b46e31b510c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:19.921303 11677 tablet_bootstrap.cc:492] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: No bootstrap required, opened a new log
I20260808 05:55:19.921384 11677 ts_tablet_manager.cc:1397] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:55:19.921502 11678 tablet_bootstrap.cc:492] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: No bootstrap required, opened a new log
I20260808 05:55:19.921581 11678 ts_tablet_manager.cc:1397] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:19.921823 11677 raft_consensus.cc:348] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.921957 11677 raft_consensus.cc:374] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.921990 11677 raft_consensus.cc:729] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baad0d448b804ac5a3b69b759e466118, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.922005 11678 raft_consensus.cc:348] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.922117 11678 raft_consensus.cc:374] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.922149 11678 raft_consensus.cc:729] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc14da7824785a00a23e8ea256519, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.922120 11677 consensus_queue.cc:260] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.922418 11677 ts_tablet_manager.cc:1428] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 05:55:19.923545 11678 consensus_queue.cc:260] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.924341 11678 ts_tablet_manager.cc:1428] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s
I20260808 05:55:19.924731 11680 tablet_bootstrap.cc:492] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: Bootstrap starting.
I20260808 05:55:19.925977 11680 tablet_bootstrap.cc:654] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:19.927821 11680 tablet_bootstrap.cc:492] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: No bootstrap required, opened a new log
I20260808 05:55:19.927946 11680 ts_tablet_manager.cc:1397] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 05:55:19.928481 11680 raft_consensus.cc:348] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.928628 11680 raft_consensus.cc:374] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:19.928680 11680 raft_consensus.cc:729] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f9bc0934ca4d81b79f4701d992b950, State: Initialized, Role: FOLLOWER
I20260808 05:55:19.928870 11680 consensus_queue.cc:260] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:19.929771 11680 ts_tablet_manager.cc:1428] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:55:20.122203 11686 raft_consensus.cc:482] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:20.122393 11686 raft_consensus.cc:504] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.123752 11686 leader_election.cc:288] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973), 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927)
I20260808 05:55:20.128418 11733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.124112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:54267 (local address 127.2.191.67:38927)
0808 05:55:20.124288 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:20.124294 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:20.124499 (+ 205us) server_negotiation.cc:407] Connection header received
0808 05:55:20.124673 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:20.124676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:20.124743 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:20.124828 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:20.125250 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.125864 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.127317 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.127848 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.127974 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.128033 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:20.128175 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:55:20.128277 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 05:55:20.128419 11765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.124011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:38927 (local address 127.2.191.65:54267)
0808 05:55:20.124391 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:20.124407 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:20.124548 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:20.124855 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:20.124858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:20.124902 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:20.125118 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:20.125130 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.125979 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.125981 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:20.127190 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:20.127201 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.127971 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.127974 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:20.128041 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.128063 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 05:55:20.128130 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:55:20.128197 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"mutex_wait_us":40,"spinlock_wait_cycles":31360,"thread_start_us":74,"threads_started":1}
I20260808 05:55:20.128860 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.124160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:45151 (local address 127.2.191.66:39973)
0808 05:55:20.124314 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:20.124318 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:20.124559 (+ 241us) server_negotiation.cc:407] Connection header received
0808 05:55:20.124665 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:20.124668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:20.124726 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:20.124825 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:20.125673 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.126262 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.127571 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.128188 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.128307 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.128355 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:20.128591 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 05:55:20.128686 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:55:20.128973 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b373cffd90314735b4698b46e31b510c" candidate_uuid: "ef7fc14da7824785a00a23e8ea256519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f9bc0934ca4d81b79f4701d992b950" is_pre_election: true
I20260808 05:55:20.129155 11597 raft_consensus.cc:2454] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc14da7824785a00a23e8ea256519 in term 0.
I20260808 05:55:20.129467 11766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.124011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:39973 (local address 127.2.191.65:45151)
0808 05:55:20.124469 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:20.124483 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:20.124560 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:20.124855 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:20.124858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:20.124904 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:20.125526 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:20.125534 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.126382 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.126385 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:20.127456 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:20.127464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.128312 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.128315 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:20.128418 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.128453 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 05:55:20.129236 (+ 783us) client_negotiation.cc:240] Negotiation successful
0808 05:55:20.129335 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":213,"spinlock_wait_cycles":5632,"thread_start_us":69,"threads_started":1}
I20260808 05:55:20.129623 11209 leader_election.cc:302] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f9bc0934ca4d81b79f4701d992b950, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:20.129941 11686 raft_consensus.cc:2781] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:20.129930 11442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b373cffd90314735b4698b46e31b510c" candidate_uuid: "ef7fc14da7824785a00a23e8ea256519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baad0d448b804ac5a3b69b759e466118" is_pre_election: true
I20260808 05:55:20.130028 11686 raft_consensus.cc:482] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:20.130090 11686 raft_consensus.cc:3037] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:20.130084 11442 raft_consensus.cc:2454] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc14da7824785a00a23e8ea256519 in term 0.
I20260808 05:55:20.131110 11686 raft_consensus.cc:504] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.131531 11686 leader_election.cc:288] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [CANDIDATE]: Term 1 election: Requested vote from peers baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973), 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927)
I20260808 05:55:20.131867 11442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b373cffd90314735b4698b46e31b510c" candidate_uuid: "ef7fc14da7824785a00a23e8ea256519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baad0d448b804ac5a3b69b759e466118"
I20260808 05:55:20.131999 11442 raft_consensus.cc:3037] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:20.131950 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b373cffd90314735b4698b46e31b510c" candidate_uuid: "ef7fc14da7824785a00a23e8ea256519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f9bc0934ca4d81b79f4701d992b950"
I20260808 05:55:20.132081 11597 raft_consensus.cc:3037] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:20.133270 11442 raft_consensus.cc:2454] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc14da7824785a00a23e8ea256519 in term 1.
I20260808 05:55:20.133270 11597 raft_consensus.cc:2454] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc14da7824785a00a23e8ea256519 in term 1.
I20260808 05:55:20.133549 11209 leader_election.cc:302] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f9bc0934ca4d81b79f4701d992b950, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:20.133757 11686 raft_consensus.cc:2781] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:20.133931 11686 raft_consensus.cc:686] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc14da7824785a00a23e8ea256519, State: Running, Role: LEADER
I20260808 05:55:20.134150 11686 consensus_queue.cc:237] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.136629 11107 catalog_manager.cc:5495] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc14da7824785a00a23e8ea256519 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "ef7fc14da7824785a00a23e8ea256519" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } health_report { overall_health: UNKNOWN } } }
I20260808 05:55:20.164103 11770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.160033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50938 (local address 127.2.191.65:34301)
0808 05:55:20.160338 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:20.160345 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:20.160358 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:20.160444 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:20.160446 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:20.160501 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:20.160619 (+ 118us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:20.160935 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.161507 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.162396 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.162647 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.162733 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.163129 (+ 396us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:20.163625 (+ 496us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:20.163725 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:20.163839 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 05:55:20.163896 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":150,"threads_started":1}
I20260808 05:55:20.166901 11597 raft_consensus.cc:1261] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Refusing update from remote peer ef7fc14da7824785a00a23e8ea256519: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:20.166920 11442 raft_consensus.cc:1261] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Refusing update from remote peer ef7fc14da7824785a00a23e8ea256519: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:20.167449 11767 consensus_queue.cc:1035] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:20.167660 11686 consensus_queue.cc:1035] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:20.171334 11696 mvcc.cc:205] Tried to move back new op lower bound from 7316146258598498304 to 7316146258471792640. Current Snapshot: MvccSnapshot[applied={T|T < 7316146258598498304}]
I20260808 05:55:20.178900 11104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:20.179092 11104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:20.181288 11104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: Sending DeleteTablet for 3 replicas of tablet b373cffd90314735b4698b46e31b510c
I20260808 05:55:20.181911 11262 tablet_service.cc:1514] Processing DeleteTablet for tablet b373cffd90314735b4698b46e31b510c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:20 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:50934
I20260808 05:55:20.182267 11704 tablet_replica.cc:330] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: stopping tablet replica
I20260808 05:55:20.182282 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet b373cffd90314735b4698b46e31b510c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:20 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:59698
I20260808 05:55:20.182469 11706 tablet_replica.cc:330] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: stopping tablet replica
I20260808 05:55:20.182420 11704 raft_consensus.cc:2229] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:55:20.182596 11706 raft_consensus.cc:2229] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:20.182736 11706 raft_consensus.cc:2258] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:20.182832 11704 raft_consensus.cc:2258] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:20.183041 11576 tablet_service.cc:1514] Processing DeleteTablet for tablet b373cffd90314735b4698b46e31b510c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:20 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:51742
I20260808 05:55:20.183239 11703 tablet_replica.cc:330] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: stopping tablet replica
I20260808 05:55:20.183350 11703 raft_consensus.cc:2229] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:20.183487 11703 raft_consensus.cc:2258] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:20.183565 11704 ts_tablet_manager.cc:1905] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:20.184245 11703 ts_tablet_manager.cc:1905] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:20.184150 11104 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53338:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:20.184656 11104 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:20.186292 11704 ts_tablet_manager.cc:1918] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:20.186383 11704 log.cc:1196] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/b373cffd90314735b4698b46e31b510c
I20260808 05:55:20.186656 11704 ts_tablet_manager.cc:1939] T b373cffd90314735b4698b46e31b510c P ef7fc14da7824785a00a23e8ea256519: Deleting consensus metadata
I20260808 05:55:20.186884 11703 ts_tablet_manager.cc:1918] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:20.186976 11703 log.cc:1196] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/b373cffd90314735b4698b46e31b510c
I20260808 05:55:20.187240 11703 ts_tablet_manager.cc:1939] T b373cffd90314735b4698b46e31b510c P 65f9bc0934ca4d81b79f4701d992b950: Deleting consensus metadata
I20260808 05:55:20.187407 11089 catalog_manager.cc:4841] TS ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301): tablet b373cffd90314735b4698b46e31b510c (table test-table [id=9652cca47fb74713b1318db76040eb3c]) successfully deleted
I20260808 05:55:20.188067 11092 catalog_manager.cc:4841] TS 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927): tablet b373cffd90314735b4698b46e31b510c (table test-table [id=9652cca47fb74713b1318db76040eb3c]) successfully deleted
I20260808 05:55:20.190024 11262 tablet_service.cc:1467] Processing CreateTablet for tablet 0e36a79e91a245dba179ca93f119feb6 (DEFAULT_TABLE table=test-table [id=de7381a5dcc140b6baf994b1d76e826b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:20.190222 11576 tablet_service.cc:1467] Processing CreateTablet for tablet 0e36a79e91a245dba179ca93f119feb6 (DEFAULT_TABLE table=test-table [id=de7381a5dcc140b6baf994b1d76e826b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:20.190294 11262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e36a79e91a245dba179ca93f119feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:20.190495 11576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e36a79e91a245dba179ca93f119feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:20.190956 11706 ts_tablet_manager.cc:1905] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:20.192710 11678 tablet_bootstrap.cc:492] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: Bootstrap starting.
I20260808 05:55:20.192971 11680 tablet_bootstrap.cc:492] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: Bootstrap starting.
I20260808 05:55:20.193672 11706 ts_tablet_manager.cc:1918] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:20.193724 11678 tablet_bootstrap.cc:654] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:20.193748 11706 log.cc:1196] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/b373cffd90314735b4698b46e31b510c
I20260808 05:55:20.193854 11680 tablet_bootstrap.cc:654] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:20.194025 11706 ts_tablet_manager.cc:1939] T b373cffd90314735b4698b46e31b510c P baad0d448b804ac5a3b69b759e466118: Deleting consensus metadata
I20260808 05:55:20.194494 11422 tablet_service.cc:1467] Processing CreateTablet for tablet 0e36a79e91a245dba179ca93f119feb6 (DEFAULT_TABLE table=test-table [id=de7381a5dcc140b6baf994b1d76e826b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:20.194756 11422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e36a79e91a245dba179ca93f119feb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:20.194813 11091 catalog_manager.cc:4841] TS baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973): tablet b373cffd90314735b4698b46e31b510c (table test-table [id=9652cca47fb74713b1318db76040eb3c]) successfully deleted
I20260808 05:55:20.196130 11680 tablet_bootstrap.cc:492] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: No bootstrap required, opened a new log
I20260808 05:55:20.196195 11680 ts_tablet_manager.cc:1397] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 05:55:20.196521 11680 raft_consensus.cc:348] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.196609 11680 raft_consensus.cc:374] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:20.196628 11680 raft_consensus.cc:729] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65f9bc0934ca4d81b79f4701d992b950, State: Initialized, Role: FOLLOWER
I20260808 05:55:20.196898 11680 consensus_queue.cc:260] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.197009 11677 tablet_bootstrap.cc:492] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: Bootstrap starting.
I20260808 05:55:20.197193 11680 ts_tablet_manager.cc:1428] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:55:20.197856 11677 tablet_bootstrap.cc:654] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:20.198045 11678 tablet_bootstrap.cc:492] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: No bootstrap required, opened a new log
I20260808 05:55:20.198128 11678 ts_tablet_manager.cc:1397] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260808 05:55:20.198560 11678 raft_consensus.cc:348] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.198676 11678 raft_consensus.cc:374] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:20.198707 11678 raft_consensus.cc:729] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef7fc14da7824785a00a23e8ea256519, State: Initialized, Role: FOLLOWER
I20260808 05:55:20.198819 11678 consensus_queue.cc:260] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.198978 11677 tablet_bootstrap.cc:492] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: No bootstrap required, opened a new log
I20260808 05:55:20.199070 11677 ts_tablet_manager.cc:1397] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:55:20.199069 11678 ts_tablet_manager.cc:1428] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:55:20.199491 11677 raft_consensus.cc:348] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.199609 11677 raft_consensus.cc:374] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:20.199648 11677 raft_consensus.cc:729] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baad0d448b804ac5a3b69b759e466118, State: Initialized, Role: FOLLOWER
I20260808 05:55:20.199765 11677 consensus_queue.cc:260] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.200047 11677 ts_tablet_manager.cc:1428] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:55:20.215672 11774 raft_consensus.cc:482] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:20.215845 11774 raft_consensus.cc:504] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.216323 11774 leader_election.cc:288] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973), 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927)
I20260808 05:55:20.216815 11442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e36a79e91a245dba179ca93f119feb6" candidate_uuid: "ef7fc14da7824785a00a23e8ea256519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baad0d448b804ac5a3b69b759e466118" is_pre_election: true
I20260808 05:55:20.216820 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e36a79e91a245dba179ca93f119feb6" candidate_uuid: "ef7fc14da7824785a00a23e8ea256519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f9bc0934ca4d81b79f4701d992b950" is_pre_election: true
I20260808 05:55:20.217018 11597 raft_consensus.cc:2454] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc14da7824785a00a23e8ea256519 in term 0.
I20260808 05:55:20.217018 11442 raft_consensus.cc:2454] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef7fc14da7824785a00a23e8ea256519 in term 0.
I20260808 05:55:20.217340 11209 leader_election.cc:302] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65f9bc0934ca4d81b79f4701d992b950, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:20.217581 11774 raft_consensus.cc:2781] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:20.217679 11774 raft_consensus.cc:482] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:20.217743 11774 raft_consensus.cc:3037] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:20.218943 11774 raft_consensus.cc:504] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.219396 11774 leader_election.cc:288] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [CANDIDATE]: Term 1 election: Requested vote from peers baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973), 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927)
I20260808 05:55:20.219790 11442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e36a79e91a245dba179ca93f119feb6" candidate_uuid: "ef7fc14da7824785a00a23e8ea256519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "baad0d448b804ac5a3b69b759e466118"
I20260808 05:55:20.219796 11597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e36a79e91a245dba179ca93f119feb6" candidate_uuid: "ef7fc14da7824785a00a23e8ea256519" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65f9bc0934ca4d81b79f4701d992b950"
I20260808 05:55:20.219929 11597 raft_consensus.cc:3037] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:20.219939 11442 raft_consensus.cc:3037] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:20.221095 11442 raft_consensus.cc:2454] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc14da7824785a00a23e8ea256519 in term 1.
I20260808 05:55:20.221171 11597 raft_consensus.cc:2454] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef7fc14da7824785a00a23e8ea256519 in term 1.
I20260808 05:55:20.221518 11208 leader_election.cc:302] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: baad0d448b804ac5a3b69b759e466118, ef7fc14da7824785a00a23e8ea256519; no voters:
I20260808 05:55:20.221773 11774 raft_consensus.cc:2781] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:20.221963 11774 raft_consensus.cc:686] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 1 LEADER]: Becoming Leader. State: Replica: ef7fc14da7824785a00a23e8ea256519, State: Running, Role: LEADER
I20260808 05:55:20.222124 11774 consensus_queue.cc:237] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } }
I20260808 05:55:20.223917 11106 catalog_manager.cc:5495] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef7fc14da7824785a00a23e8ea256519 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "ef7fc14da7824785a00a23e8ea256519" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef7fc14da7824785a00a23e8ea256519" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 34301 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 } health_report { overall_health: UNKNOWN } } }
I20260808 05:55:20.250969 11783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.247089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:39973 (local address 127.2.191.65:35357)
0808 05:55:20.247406 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:20.247422 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:20.247560 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:20.247822 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:20.247825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:20.247832 (+ 7us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:55:20.247968 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:20.247974 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.248772 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.248776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:20.249596 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:20.249614 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.250109 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.250113 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:20.250224 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.250275 (+ 51us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:55:20.250652 (+ 377us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:55:20.250660 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 05:55:20.250722 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:55:20.250806 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":99,"threads_started":1}
I20260808 05:55:20.250952 11673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.246862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:35357 (local address 127.2.191.66:39973)
0808 05:55:20.247030 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:20.247035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:20.247515 (+ 480us) server_negotiation.cc:407] Connection header received
0808 05:55:20.247668 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:20.247670 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:20.247720 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:20.247789 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:20.248088 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.248606 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.249734 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.249978 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.250110 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.250449 (+ 339us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:20.250544 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:20.250625 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:20.250732 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:55:20.250791 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 05:55:20.257143 11596 raft_consensus.cc:1261] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Refusing update from remote peer ef7fc14da7824785a00a23e8ea256519: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:20.257225 11442 raft_consensus.cc:1261] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Refusing update from remote peer ef7fc14da7824785a00a23e8ea256519: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:20.257611 11686 consensus_queue.cc:1035] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [LEADER]: Connected to new peer: Peer: permanent_uuid: "baad0d448b804ac5a3b69b759e466118" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:20.257907 11686 consensus_queue.cc:1035] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65f9bc0934ca4d81b79f4701d992b950" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:20.277693 11743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.273108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:34301 (local address 127.2.191.66:53535)
0808 05:55:20.273311 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:20.273327 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:20.273405 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:20.274148 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:20.274152 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:20.274160 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:55:20.274267 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:20.274273 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.275055 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.275058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:20.276014 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:20.276025 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.276897 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.276900 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:20.277003 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.277041 (+ 38us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:55:20.277368 (+ 327us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:55:20.277375 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 05:55:20.277432 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:55:20.277534 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100}
I20260808 05:55:20.278072 11770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:20.273726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:53535 (local address 127.2.191.65:34301)
0808 05:55:20.273830 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:20.273834 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:20.273846 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:55:20.273889 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:20.273892 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:20.273940 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:20.274026 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:20.274383 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.274932 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.276318 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:20.276658 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:20.276806 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:20.277176 (+ 370us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:20.277266 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:20.277331 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:20.277880 (+ 549us) server_negotiation.cc:299] Negotiation successful
0808 05:55:20.277941 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:55:20.299976 11104 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:20.300177 11104 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53338:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:20.302340 11104 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 67b42f3d651141b49e8e5edbc03e3601: Sending DeleteTablet for 3 replicas of tablet 0e36a79e91a245dba179ca93f119feb6
I20260808 05:55:20.302959 11422 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e36a79e91a245dba179ca93f119feb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:20 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:59698
I20260808 05:55:20.303066 11262 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e36a79e91a245dba179ca93f119feb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:20 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:50934
I20260808 05:55:20.303222 11576 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e36a79e91a245dba179ca93f119feb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:20 UTC) from {username='oryx', principal='oryx/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:51742
I20260808 05:55:20.303246 11704 tablet_replica.cc:330] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: stopping tablet replica
I20260808 05:55:20.303400 11706 tablet_replica.cc:330] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: stopping tablet replica
I20260808 05:55:20.303407 11704 raft_consensus.cc:2229] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:55:20.303574 11706 raft_consensus.cc:2229] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:20.303624 11704 raft_consensus.cc:2258] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:20.303725 11706 raft_consensus.cc:2258] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:20.303910 11703 tablet_replica.cc:330] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: stopping tablet replica
I20260808 05:55:20.304055 11703 raft_consensus.cc:2229] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:20.304209 11703 raft_consensus.cc:2258] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:20.304388 11704 ts_tablet_manager.cc:1905] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:20.305255 11703 ts_tablet_manager.cc:1905] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:20.305274 11706 ts_tablet_manager.cc:1905] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:20.307245 11704 ts_tablet_manager.cc:1918] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:55:20.307327 11704 log.cc:1196] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/0e36a79e91a245dba179ca93f119feb6
I20260808 05:55:20.307590 11704 ts_tablet_manager.cc:1939] T 0e36a79e91a245dba179ca93f119feb6 P ef7fc14da7824785a00a23e8ea256519: Deleting consensus metadata
I20260808 05:55:20.307804 11706 ts_tablet_manager.cc:1918] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:55:20.307804 11703 ts_tablet_manager.cc:1918] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:55:20.307880 11706 log.cc:1196] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/0e36a79e91a245dba179ca93f119feb6
I20260808 05:55:20.307880 11703 log.cc:1196] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/0e36a79e91a245dba179ca93f119feb6
I20260808 05:55:20.308153 11706 ts_tablet_manager.cc:1939] T 0e36a79e91a245dba179ca93f119feb6 P baad0d448b804ac5a3b69b759e466118: Deleting consensus metadata
I20260808 05:55:20.308145 11703 ts_tablet_manager.cc:1939] T 0e36a79e91a245dba179ca93f119feb6 P 65f9bc0934ca4d81b79f4701d992b950: Deleting consensus metadata
I20260808 05:55:20.308691 11089 catalog_manager.cc:4841] TS ef7fc14da7824785a00a23e8ea256519 (127.2.191.65:34301): tablet 0e36a79e91a245dba179ca93f119feb6 (table test-table [id=de7381a5dcc140b6baf994b1d76e826b]) successfully deleted
I20260808 05:55:20.308949 11091 catalog_manager.cc:4841] TS baad0d448b804ac5a3b69b759e466118 (127.2.191.66:39973): tablet 0e36a79e91a245dba179ca93f119feb6 (table test-table [id=de7381a5dcc140b6baf994b1d76e826b]) successfully deleted
I20260808 05:55:20.309226 11092 catalog_manager.cc:4841] TS 65f9bc0934ca4d81b79f4701d992b950 (127.2.191.67:38927): tablet 0e36a79e91a245dba179ca93f119feb6 (table test-table [id=de7381a5dcc140b6baf994b1d76e826b]) successfully deleted
I20260808 05:55:20.309681 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 11187
I20260808 05:55:20.319186 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 11347
I20260808 05:55:20.328629 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 11504
I20260808 05:55:20.338351 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 11071
2026-08-08T05:55:20Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3696 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:55:20 dist-test-slave-qg60 krb5kdc[11790](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:55:20 dist-test-slave-qg60 krb5kdc[11790](info): set up 2 sockets
Aug 08 05:55:20 dist-test-slave-qg60 krb5kdc[11790](info): commencing operation
krb5kdc: starting...
W20260808 05:55:21.441197 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.007s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:21 dist-test-slave-qg60 krb5kdc[11790](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:55:21.575569 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42865
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44067
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:42865
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:21.690042 11805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:21.690529 11805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:21.690603 11805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:21.695040 11805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:21.695148 11805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:21.695184 11805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:21.695225 11805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:21.695261 11805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:21.700960 11805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44067
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:42865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11805
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:21.702145 11805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:21.703250 11805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:21.712759 11812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:21.712766 11813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:21.712774 11815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:21.712826 11805 server_base.cc:1034] running on GCE node
I20260808 05:55:21.713703 11805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:21.714884 11805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:21.716091 11805 hybrid_clock.cc:648] HybridClock initialized: now 1786168521716078 us; error 42 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T05:55:21Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1382 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:55:21 dist-test-slave-qg60 krb5kdc[11820](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:55:21 dist-test-slave-qg60 krb5kdc[11820](info): set up 2 sockets
Aug 08 05:55:21 dist-test-slave-qg60 krb5kdc[11820](info): commencing operation
krb5kdc: starting...
W20260808 05:55:22.820690 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:22 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:55:22.953827 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:40281
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:40281
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:23.070674 11838 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:23.071013 11838 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:23.071105 11838 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:23.075309 11838 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:23.075402 11838 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:23.075440 11838 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:23.075495 11838 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:23.075536 11838 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:23.081350 11838 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:40281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:40281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11838
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:23.082538 11838 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:23.083624 11838 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:23.092577 11844 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:23.092649 11847 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:23.092549 11845 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:23.092753 11838 server_base.cc:1034] running on GCE node
I20260808 05:55:23.093391 11838 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:23.094612 11838 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:23.095785 11838 hybrid_clock.cc:648] HybridClock initialized: now 1786168523095777 us; error 31 us; skew 500 ppm
Aug 08 05:55:23 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168523, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:23.104103 11838 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:55:23.105141 11838 webserver.cc:460] Webserver started at http://127.2.191.126:38459/ using document root <none> and password file <none>
I20260808 05:55:23.105952 11838 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:23.106058 11838 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:23.106346 11838 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:23.109846 11838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "17f0ab31830b46c0983151d9f4ca28a6"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "d4d53817558e2583a569d37ddf5e6094"
server_key_iv: "cd568f23af1c0f3044b3dc71a6024ad6"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.110410 11838 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "17f0ab31830b46c0983151d9f4ca28a6"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "d4d53817558e2583a569d37ddf5e6094"
server_key_iv: "cd568f23af1c0f3044b3dc71a6024ad6"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.114506 11838 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:23.117399 11857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.118762 11838 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:23.118918 11838 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "17f0ab31830b46c0983151d9f4ca28a6"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "d4d53817558e2583a569d37ddf5e6094"
server_key_iv: "cd568f23af1c0f3044b3dc71a6024ad6"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.119047 11838 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:23.141673 11838 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:23.144999 11838 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:23.145210 11838 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:23.152624 11838 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:40281
I20260808 05:55:23.152653 11917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:40281 every 8 connection(s)
I20260808 05:55:23.153647 11838 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:23.156479 11918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:23.162005 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 11838
I20260808 05:55:23.162160 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:23.162470 2813 external_mini_cluster.cc:1428] Setting key feff123d7fa40fa98f43f957f5744abe
I20260808 05:55:23.162631 11918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Bootstrap starting.
I20260808 05:55:23.165333 11918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:23.166105 11918 log.cc:824] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:23.167944 11918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: No bootstrap required, opened a new log
Aug 08 05:55:23 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168522, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:23.172289 11918 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } }
I20260808 05:55:23.172540 11918 raft_consensus.cc:374] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:23.172621 11918 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f0ab31830b46c0983151d9f4ca28a6, State: Initialized, Role: FOLLOWER
I20260808 05:55:23.173126 11918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } }
I20260808 05:55:23.173280 11918 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:23.173365 11918 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:23.173470 11918 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:23.174376 11918 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } }
I20260808 05:55:23.174716 11918 leader_election.cc:302] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17f0ab31830b46c0983151d9f4ca28a6; no voters:
I20260808 05:55:23.175064 11918 leader_election.cc:288] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:23.175200 11924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:23.175443 11924 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 1 LEADER]: Becoming Leader. State: Replica: 17f0ab31830b46c0983151d9f4ca28a6, State: Running, Role: LEADER
I20260808 05:55:23.175753 11924 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } }
I20260808 05:55:23.176406 11918 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:23.176975 11926 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17f0ab31830b46c0983151d9f4ca28a6. Latest consensus state: current_term: 1 leader_uuid: "17f0ab31830b46c0983151d9f4ca28a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } } }
I20260808 05:55:23.177189 11926 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:23.177433 11925 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "17f0ab31830b46c0983151d9f4ca28a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } } }
I20260808 05:55:23.177531 11925 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:23.178021 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:23.163924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56432 (local address 127.2.191.126:40281)
0808 05:55:23.164402 (+ 478us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:23.164418 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:23.164453 (+ 35us) server_negotiation.cc:407] Connection header received
0808 05:55:23.165189 (+ 736us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:23.165208 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:23.165589 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:23.165925 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:23.166779 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.167752 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.168682 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.169212 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.169382 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:23.172308 (+ 2926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:23.172313 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:23.172327 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:23.172354 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:23.174202 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:23.174684 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:23.174689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:23.174693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:23.174825 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:23.175198 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:23.175201 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:23.175203 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:23.175784 (+ 581us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:23.175987 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:23.176404 (+ 417us) server_negotiation.cc:299] Negotiation successful
0808 05:55:23.176926 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":154,"threads_started":1}
W20260808 05:55:23.181121 11941 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:55:23.181208 11941 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:55:23.181288 11932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:23.181973 11932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:23.187712 11932 catalog_manager.cc:1347] Generated new cluster ID: 6407fdc6a4ec4696aaa14e110185e15a
I20260808 05:55:23.187813 11932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:23.204411 11932 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:23.205833 11932 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:23.218490 11932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Generated new TSK 0
I20260808 05:55:23.219373 11932 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:55:23.256408 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:40281
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:23.374533 11947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:23.374811 11947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:23.374889 11947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:23.379305 11947 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:23.379379 11947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:23.379485 11947 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:23.384967 11947 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:40281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11947
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:23.386109 11947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:23.387162 11947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:23.397058 11953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:23.397153 11952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:23.397153 11955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:23.397637 11947 server_base.cc:1034] running on GCE node
I20260808 05:55:23.398162 11947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:23.398815 11947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:23.400050 11947 hybrid_clock.cc:648] HybridClock initialized: now 1786168523400032 us; error 30 us; skew 500 ppm
Aug 08 05:55:23 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168523, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:23.403064 11947 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:55:23.403985 11947 webserver.cc:460] Webserver started at http://127.2.191.65:40759/ using document root <none> and password file <none>
I20260808 05:55:23.404572 11947 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:23.404670 11947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:23.404934 11947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:23.407073 11947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "0f81f7f0f0b94f088a8cc2b1245c9e43"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "1dd12a6f4ab06f41dcd8f0969f701ee4"
server_key_iv: "f3ff95ac4c779ff9bd9225980ab37fee"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.407663 11947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "0f81f7f0f0b94f088a8cc2b1245c9e43"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "1dd12a6f4ab06f41dcd8f0969f701ee4"
server_key_iv: "f3ff95ac4c779ff9bd9225980ab37fee"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.411580 11947 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:23.414175 11962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.415668 11947 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:55:23.415829 11947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "0f81f7f0f0b94f088a8cc2b1245c9e43"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "1dd12a6f4ab06f41dcd8f0969f701ee4"
server_key_iv: "f3ff95ac4c779ff9bd9225980ab37fee"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.415958 11947 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:23.438556 11947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:23.441748 11947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:23.441965 11947 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:23.442597 11947 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:23.443487 11947 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:23.443560 11947 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.443632 11947 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:23.443682 11947 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.452993 11947 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:39851
I20260808 05:55:23.453020 12085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:39851 every 8 connection(s)
I20260808 05:55:23.453943 11947 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:55:23 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168523, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:23.463891 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 11947
I20260808 05:55:23.464031 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:23.464403 2813 external_mini_cluster.cc:1428] Setting key 37fb0045609a456bf6f2dabcb55a34ce
I20260808 05:55:23.467909 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:23.455826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:43331 (local address 127.2.191.126:40281)
0808 05:55:23.456013 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:23.456019 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:23.456823 (+ 804us) server_negotiation.cc:407] Connection header received
0808 05:55:23.458132 (+ 1309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:23.458135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:23.458185 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:23.458267 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:23.459437 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.459996 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.461200 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.461422 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.461502 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:23.464147 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:23.464152 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:23.464154 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:23.464186 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:23.465794 (+ 1608us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:23.466376 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:23.466381 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:23.466383 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:23.466468 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:23.466823 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:23.466826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:23.466828 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:23.467009 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:23.467126 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:23.467609 (+ 483us) server_negotiation.cc:299] Negotiation successful
0808 05:55:23.467736 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260808 05:55:23.468883 12090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:23.456146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:43331)
0808 05:55:23.456628 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:23.456675 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:23.457900 (+ 1225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:23.458426 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:23.458432 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:23.458819 (+ 387us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:23.459301 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:23.459315 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.460105 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.460108 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:23.461076 (+ 968us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:23.461086 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.461560 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.461563 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:23.461721 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:23.462398 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:23.462414 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:23.463892 (+ 1478us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:23.465917 (+ 2025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:23.465923 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:23.465939 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:23.466267 (+ 328us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:23.466562 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:23.466566 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:23.466568 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:23.466723 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:23.467117 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:23.467123 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:23.467368 (+ 245us) client_negotiation.cc:769] Sending connection context
0808 05:55:23.467553 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 05:55:23.467882 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":119,"threads_started":1}
I20260808 05:55:23.470081 12087 heartbeater.cc:347] Connected to a master server at 127.2.191.126:40281
I20260808 05:55:23.470329 12087 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:23.470808 12087 heartbeater.cc:511] Master 127.2.191.126:40281 requested a full tablet report, sending...
I20260808 05:55:23.472496 11873 ts_manager.cc:194] Registered new tserver with Master: 0f81f7f0f0b94f088a8cc2b1245c9e43 (127.2.191.65:39851)
I20260808 05:55:23.474180 11873 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:43331
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:55:23.496505 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:40281
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:23.610425 12094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:23.610702 12094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:23.610745 12094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:23.614998 12094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:23.615073 12094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:23.615173 12094 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:23.620885 12094 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:40281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:23.621987 12094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:23.623178 12094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:23.633636 12099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:23.633636 12100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:23.633639 12102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:23.634049 12094 server_base.cc:1034] running on GCE node
I20260808 05:55:23.634498 12094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:23.635238 12094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:23.636418 12094 hybrid_clock.cc:648] HybridClock initialized: now 1786168523636384 us; error 45 us; skew 500 ppm
Aug 08 05:55:23 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168523, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:23.639349 12094 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:55:23.640270 12094 webserver.cc:460] Webserver started at http://127.2.191.66:41613/ using document root <none> and password file <none>
I20260808 05:55:23.640870 12094 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:23.640939 12094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:23.641110 12094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:23.643220 12094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "8f468ad2df124d1aa455d9be4afe88b9"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "1fbcfbdc5d1d1cca54098d8d41babf4a"
server_key_iv: "42176d976ffe21659f1bf91dd893a730"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.643756 12094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "8f468ad2df124d1aa455d9be4afe88b9"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "1fbcfbdc5d1d1cca54098d8d41babf4a"
server_key_iv: "42176d976ffe21659f1bf91dd893a730"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.647595 12094 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:23.650118 12109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.651371 12094 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:55:23.651494 12094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "8f468ad2df124d1aa455d9be4afe88b9"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "1fbcfbdc5d1d1cca54098d8d41babf4a"
server_key_iv: "42176d976ffe21659f1bf91dd893a730"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.651630 12094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:23.680022 12094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:23.683467 12094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:23.683687 12094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:23.684311 12094 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:23.685191 12094 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:23.685240 12094 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.685281 12094 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:23.685302 12094 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.693874 12094 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:46249
I20260808 05:55:23.693879 12234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:46249 every 8 connection(s)
I20260808 05:55:23.694790 12094 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:23.704147 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 12094
I20260808 05:55:23.704305 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:23.704605 2813 external_mini_cluster.cc:1428] Setting key 3596d1f6773736e07e23a7a76b909560
Aug 08 05:55:23 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168523, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:23.709312 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:23.696651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:59779 (local address 127.2.191.126:40281)
0808 05:55:23.696824 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:23.696829 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:23.697762 (+ 933us) server_negotiation.cc:407] Connection header received
0808 05:55:23.699171 (+ 1409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:23.699175 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:23.699223 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:23.699300 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:23.700667 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.701242 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.702483 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.702701 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.702794 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:23.705487 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:23.705489 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:23.705492 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:23.705515 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:23.707008 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:23.707532 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:23.707536 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:23.707538 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:23.707633 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:23.707967 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:23.707972 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:23.707974 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:23.708253 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:23.708361 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:23.708947 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 05:55:23.709086 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:55:23.710214 12237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:23.697121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:59779)
0808 05:55:23.697593 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:23.697652 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:23.698941 (+ 1289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:23.699519 (+ 578us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:23.699526 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:23.699947 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:23.700521 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:23.700536 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.701434 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.701437 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:23.702341 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:23.702351 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.702853 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.702856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:23.702999 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:23.703600 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:23.703616 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:23.705336 (+ 1720us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:23.707144 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:23.707150 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:23.707166 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:23.707426 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:23.707726 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:23.707730 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:23.707732 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:23.707872 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:23.708386 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:23.708391 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:23.708637 (+ 246us) client_negotiation.cc:769] Sending connection context
0808 05:55:23.708863 (+ 226us) client_negotiation.cc:240] Negotiation successful
0808 05:55:23.709176 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"thread_start_us":103,"threads_started":1}
I20260808 05:55:23.711360 12235 heartbeater.cc:347] Connected to a master server at 127.2.191.126:40281
I20260808 05:55:23.711634 12235 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:23.712141 12235 heartbeater.cc:511] Master 127.2.191.126:40281 requested a full tablet report, sending...
I20260808 05:55:23.713227 11873 ts_manager.cc:194] Registered new tserver with Master: 8f468ad2df124d1aa455d9be4afe88b9 (127.2.191.66:46249)
I20260808 05:55:23.713809 11873 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:59779
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:55:23.736536 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:40281
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:23.850682 12240 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:23.851025 12240 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:23.851107 12240 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:23.855406 12240 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:23.855508 12240 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:23.855626 12240 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:23.861452 12240 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:40281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12240
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:23.862962 12240 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:23.864212 12240 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:23.875146 12249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:23.875169 12250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:23.875159 12252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:23.875381 12240 server_base.cc:1034] running on GCE node
I20260808 05:55:23.875963 12240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:23.876868 12240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:23.878340 12240 hybrid_clock.cc:648] HybridClock initialized: now 1786168523878303 us; error 51 us; skew 500 ppm
Aug 08 05:55:23 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168523, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:23.888176 12240 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:55:23.889582 12240 webserver.cc:460] Webserver started at http://127.2.191.67:36883/ using document root <none> and password file <none>
I20260808 05:55:23.890388 12240 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:23.890466 12240 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:23.890679 12240 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:23.893549 12240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "9a5f25eba38c42bdbeb7bb32da673357"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "a9cd233ca24fcc243db9b61d1b8b180b"
server_key_iv: "a66cd5abf8680e00ee49531022026c09"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.894212 12240 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "9a5f25eba38c42bdbeb7bb32da673357"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "a9cd233ca24fcc243db9b61d1b8b180b"
server_key_iv: "a66cd5abf8680e00ee49531022026c09"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.898974 12240 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260808 05:55:23.904352 12259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.906114 12240 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260808 05:55:23.906260 12240 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "9a5f25eba38c42bdbeb7bb32da673357"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "a9cd233ca24fcc243db9b61d1b8b180b"
server_key_iv: "a66cd5abf8680e00ee49531022026c09"
server_key_version: "encryptionkey@0"
I20260808 05:55:23.906414 12240 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:23.924569 12240 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:23.928694 12240 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:23.928982 12240 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:23.929863 12240 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:23.931125 12240 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:23.931202 12240 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.931269 12240 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:23.931309 12240 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:23.940845 12240 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:45007
I20260808 05:55:23.940881 12388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:45007 every 8 connection(s)
I20260808 05:55:23.941795 12240 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:23.944211 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 12240
I20260808 05:55:23.944368 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:23.944679 2813 external_mini_cluster.cc:1428] Setting key 83e709168865e60e17939c3731a13221
Aug 08 05:55:23 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168523, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:23.955770 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:23.943665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:58169 (local address 127.2.191.126:40281)
0808 05:55:23.943821 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:23.943826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:23.944802 (+ 976us) server_negotiation.cc:407] Connection header received
0808 05:55:23.946201 (+ 1399us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:23.946205 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:23.946256 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:23.946339 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:23.947434 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.947981 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.949263 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.949475 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.949562 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:23.952012 (+ 2450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:23.952015 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:23.952017 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:23.952042 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:23.953573 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:23.954046 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:23.954049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:23.954050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:23.954126 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:23.954433 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:23.954435 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:23.954436 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:23.954684 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:23.954803 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:23.955446 (+ 643us) server_negotiation.cc:299] Negotiation successful
0808 05:55:23.955573 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:55:23.956635 12392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:23.944100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:58169)
0808 05:55:23.944613 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:23.944667 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:23.946013 (+ 1346us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:23.946474 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:23.946480 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:23.946836 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:23.947308 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:23.947321 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.948115 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.948118 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:23.949152 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:23.949162 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:23.949662 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:23.949665 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:23.949816 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:23.950347 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:23.950364 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:23.951853 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:23.953691 (+ 1838us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:23.953696 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:23.953708 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:23.953959 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:23.954210 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:23.954213 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:23.954214 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:23.954354 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:23.954804 (+ 450us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:23.954812 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:23.955177 (+ 365us) client_negotiation.cc:769] Sending connection context
0808 05:55:23.955400 (+ 223us) client_negotiation.cc:240] Negotiation successful
0808 05:55:23.955763 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":148,"threads_started":1}
I20260808 05:55:23.957934 12389 heartbeater.cc:347] Connected to a master server at 127.2.191.126:40281
I20260808 05:55:23.958192 12389 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:23.958720 12389 heartbeater.cc:511] Master 127.2.191.126:40281 requested a full tablet report, sending...
I20260808 05:55:23.959728 11873 ts_manager.cc:194] Registered new tserver with Master: 9a5f25eba38c42bdbeb7bb32da673357 (127.2.191.67:45007)
I20260808 05:55:23.960299 11873 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:58169
I20260808 05:55:23.970852 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab.
Entry for principal oryx/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab.
WARNING: no policy specified for oryx/127.2.191.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab.
Entry for principal oryx/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab.
WARNING: no policy specified for oryx/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab.
Entry for principal oryx/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab.
I20260808 05:55:24.055853 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 11947
I20260808 05:55:24.065224 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 12094
I20260808 05:55:24.073596 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 12240
I20260808 05:55:24.082276 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 11838
I20260808 05:55:24.091444 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:40281
--webserver_interface=127.2.191.126
--webserver_port=38459
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:40281
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:24.207268 12399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:24.207573 12399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:24.207651 12399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:24.211776 12399 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:24.211858 12399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:24.211877 12399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:24.211894 12399 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:24.211956 12399 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:24.217512 12399 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:40281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:40281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=38459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:24.218657 12399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:24.219743 12399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:24.228837 12405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:24.228790 12410 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:24.228958 12399 server_base.cc:1034] running on GCE node
W20260808 05:55:24.229218 12406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:24.229812 12399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:24.230989 12399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:24.232180 12399 hybrid_clock.cc:648] HybridClock initialized: now 1786168524232163 us; error 29 us; skew 500 ppm
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168524, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:24.235185 12399 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:55:24.236119 12399 webserver.cc:460] Webserver started at http://127.2.191.126:38459/ using document root <none> and password file <none>
I20260808 05:55:24.236670 12399 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:24.236795 12399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:24.240832 12399 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 05:55:24.243054 12417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.244349 12399 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:55:24.244583 12399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "17f0ab31830b46c0983151d9f4ca28a6"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "d4d53817558e2583a569d37ddf5e6094"
server_key_iv: "cd568f23af1c0f3044b3dc71a6024ad6"
server_key_version: "encryptionkey@0"
I20260808 05:55:24.245213 12399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:24.265506 12399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:24.268910 12399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:24.269152 12399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:24.276818 12399 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:40281
I20260808 05:55:24.276849 12475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:40281 every 8 connection(s)
I20260808 05:55:24.277961 12399 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:24.278676 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 12399
I20260808 05:55:24.279161 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:39851
--local_ip_for_outbound_sockets=127.2.191.65
--tserver_master_addrs=127.2.191.126:40281
--webserver_port=40759
--webserver_interface=127.2.191.65
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.2.191.65
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:55:24.282608 12476 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:55:24.285059 12476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Bootstrap starting.
I20260808 05:55:24.302901 12476 log.cc:824] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:24.309840 12476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:55:24.310256 12476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Bootstrap complete.
I20260808 05:55:24.314903 12476 raft_consensus.cc:348] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } }
I20260808 05:55:24.315622 12476 raft_consensus.cc:729] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17f0ab31830b46c0983151d9f4ca28a6, State: Initialized, Role: FOLLOWER
I20260808 05:55:24.316172 12476 consensus_queue.cc:260] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } }
I20260808 05:55:24.316296 12476 raft_consensus.cc:388] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:24.316383 12476 raft_consensus.cc:482] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:24.316481 12476 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:55:24.318588 12476 raft_consensus.cc:504] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } }
I20260808 05:55:24.318929 12476 leader_election.cc:302] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 17f0ab31830b46c0983151d9f4ca28a6; no voters:
I20260808 05:55:24.319279 12476 leader_election.cc:288] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:55:24.319391 12480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:55:24.319653 12480 raft_consensus.cc:686] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [term 2 LEADER]: Becoming Leader. State: Replica: 17f0ab31830b46c0983151d9f4ca28a6, State: Running, Role: LEADER
I20260808 05:55:24.319958 12480 consensus_queue.cc:237] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } }
I20260808 05:55:24.320658 12476 sys_catalog.cc:564] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:24.320973 12480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 17f0ab31830b46c0983151d9f4ca28a6. Latest consensus state: current_term: 2 leader_uuid: "17f0ab31830b46c0983151d9f4ca28a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } } }
I20260808 05:55:24.321102 12480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:24.321516 12481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "17f0ab31830b46c0983151d9f4ca28a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "17f0ab31830b46c0983151d9f4ca28a6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40281 } } }
I20260808 05:55:24.321694 12481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:24.322012 12486 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:24.325534 12486 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:24.326440 12486 catalog_manager.cc:1259] Loaded cluster ID: 6407fdc6a4ec4696aaa14e110185e15a
I20260808 05:55:24.326519 12486 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:24.328944 12486 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:24.329595 12486 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 17f0ab31830b46c0983151d9f4ca28a6: Loaded TSK: 0
I20260808 05:55:24.330801 12486 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:55:24.400363 12478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:24.400635 12478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:24.400678 12478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:24.404794 12478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:24.404856 12478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:24.404947 12478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:24.410262 12478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.65.keytab
--principal=oryx/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:39851
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=40759
--tserver_master_addrs=127.2.191.126:40281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:24.411525 12478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:24.412624 12478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:24.422464 12505 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:24.422478 12508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:24.422484 12506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:24.423036 12478 server_base.cc:1034] running on GCE node
I20260808 05:55:24.423552 12478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:24.424266 12478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:24.425449 12478 hybrid_clock.cc:648] HybridClock initialized: now 1786168524425421 us; error 47 us; skew 500 ppm
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168524, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:24.428617 12478 init.cc:377] Logged in from keytab as oryx/127.2.191.65@KRBTEST.COM (short username oryx)
I20260808 05:55:24.429669 12478 webserver.cc:460] Webserver started at http://127.2.191.65:40759/ using document root <none> and password file <none>
I20260808 05:55:24.430241 12478 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:24.430352 12478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:24.434369 12478 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:55:24.436707 12515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.438155 12478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:55:24.438295 12478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "0f81f7f0f0b94f088a8cc2b1245c9e43"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "1dd12a6f4ab06f41dcd8f0969f701ee4"
server_key_iv: "f3ff95ac4c779ff9bd9225980ab37fee"
server_key_version: "encryptionkey@0"
I20260808 05:55:24.438890 12478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:24.449294 12478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:24.452713 12478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:24.452988 12478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:24.453670 12478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:24.454548 12478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:24.454627 12478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.454702 12478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:24.454746 12478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.466300 12478 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:39851
I20260808 05:55:24.466342 12642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:39851 every 8 connection(s)
I20260808 05:55:24.467427 12478 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:24.477241 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 12478
I20260808 05:55:24.477732 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:46249
--local_ip_for_outbound_sockets=127.2.191.66
--tserver_master_addrs=127.2.191.126:40281
--webserver_port=41613
--webserver_interface=127.2.191.66
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.2.191.66
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:55:24.481127 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.469670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:56883 (local address 127.2.191.126:40281)
0808 05:55:24.470153 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.470174 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.470515 (+ 341us) server_negotiation.cc:407] Connection header received
0808 05:55:24.472014 (+ 1499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.472029 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.472325 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.472655 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.473828 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.474800 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.475938 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.476408 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.476594 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.480369 (+ 3775us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:56883: BlockingRecv error: recv got EOF from 127.2.191.65:56883 (error 108)
Metrics: {"server-negotiator.queue_time_us":304,"thread_start_us":131,"threads_started":1}
I20260808 05:55:24.481139 12646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.469847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:56883)
0808 05:55:24.470355 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.470399 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.471589 (+ 1190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.472761 (+ 1172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.472770 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.473210 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.473660 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.473673 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.474949 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.474953 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.475810 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.475820 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.476585 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.476589 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.476804 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.477458 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.477475 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.480080 (+ 2605us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":141,"threads_started":1}
W20260808 05:55:24.482221 12643 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:40281 (0 consecutive failures): Not authorized: Failed to ping master at 127.2.191.126:40281: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:24.488801 12646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.482737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:50039)
0808 05:55:24.482940 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.482959 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.483064 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.483331 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.483337 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.483533 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.483691 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.483701 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.484417 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.484423 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.485469 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.485483 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.485937 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.485943 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.486081 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.486605 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.486624 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.488622 (+ 1998us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116}
W20260808 05:55:24.488893 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.482846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:50039 (local address 127.2.191.126:40281)
0808 05:55:24.482958 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.482961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.483020 (+ 59us) server_negotiation.cc:407] Connection header received
0808 05:55:24.483168 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.483170 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.483209 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.483284 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.483807 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.484306 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.485595 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.485816 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.485895 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.488775 (+ 2880us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:50039: BlockingRecv error: recv got EOF from 127.2.191.65:50039 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:24.494344 12646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.489511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:52973)
0808 05:55:24.489640 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.489655 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.489740 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.489981 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.489984 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.490140 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.490209 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.490214 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.490915 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.490921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.491428 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.491435 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.491878 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.491881 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.491966 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.492458 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.492470 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.494198 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 05:55:24.494432 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.489567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:52973 (local address 127.2.191.126:40281)
0808 05:55:24.489676 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.489683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.489697 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:24.489834 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.489837 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.489879 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.489965 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.490320 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.490810 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.491550 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.491770 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.491874 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.494318 (+ 2444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:52973: BlockingRecv error: recv got EOF from 127.2.191.65:52973 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
W20260808 05:55:24.494756 12643 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:55:24.595866 12647 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:24.596181 12647 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:24.596256 12647 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:24.600358 12647 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:24.600461 12647 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:24.600555 12647 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:24.606185 12647 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.66.keytab
--principal=oryx/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:46249
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=41613
--tserver_master_addrs=127.2.191.126:40281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:24.607333 12647 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:24.608407 12647 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:24.618461 12652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:24.618659 12647 server_base.cc:1034] running on GCE node
W20260808 05:55:24.618470 12655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:24.618462 12653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:24.619329 12647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:24.619985 12647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:24.621167 12647 hybrid_clock.cc:648] HybridClock initialized: now 1786168524621153 us; error 32 us; skew 500 ppm
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168524, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:24.624239 12647 init.cc:377] Logged in from keytab as oryx/127.2.191.66@KRBTEST.COM (short username oryx)
I20260808 05:55:24.625263 12647 webserver.cc:460] Webserver started at http://127.2.191.66:41613/ using document root <none> and password file <none>
I20260808 05:55:24.625830 12647 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:24.625937 12647 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:24.630028 12647 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:55:24.632198 12664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.633505 12647 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:24.633646 12647 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "8f468ad2df124d1aa455d9be4afe88b9"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "1fbcfbdc5d1d1cca54098d8d41babf4a"
server_key_iv: "42176d976ffe21659f1bf91dd893a730"
server_key_version: "encryptionkey@0"
I20260808 05:55:24.634251 12647 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:24.643957 12647 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:24.647258 12647 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:24.647466 12647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:24.648068 12647 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:24.649051 12647 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:24.649123 12647 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.649194 12647 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:24.649242 12647 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.658583 12647 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:46249
I20260808 05:55:24.658617 12791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:46249 every 8 connection(s)
I20260808 05:55:24.659602 12647 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:24.665666 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 12647
I20260808 05:55:24.666193 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:45007
--local_ip_for_outbound_sockets=127.2.191.67
--tserver_master_addrs=127.2.191.126:40281
--webserver_port=36883
--webserver_interface=127.2.191.67
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33591
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.2.191.67
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:55:24.671789 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.661420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:53203 (local address 127.2.191.126:40281)
0808 05:55:24.661567 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.661571 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.662518 (+ 947us) server_negotiation.cc:407] Connection header received
0808 05:55:24.663681 (+ 1163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.663684 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.663736 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.663819 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.665054 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.665594 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.667330 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.667555 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.667649 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.671656 (+ 4007us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:53203: BlockingRecv error: recv got EOF from 127.2.191.66:53203 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:55:24.672430 12794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.661798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:53203)
0808 05:55:24.662273 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.662322 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.663464 (+ 1142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.663985 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.663992 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.664356 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.664852 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.664865 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.665728 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.665734 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.667174 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.667190 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.667724 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.667730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.667965 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.668759 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.668785 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.671495 (+ 2710us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":106,"threads_started":1}
W20260808 05:55:24.672955 12792 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:40281 (0 consecutive failures): Not authorized: Failed to ping master at 127.2.191.126:40281: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:24.678750 12794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.673525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:38415)
0808 05:55:24.673655 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.673672 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.673757 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.674014 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.674017 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.674203 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.674290 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.674295 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.675019 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.675026 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.675561 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.675568 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.676002 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.676006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.676107 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.676628 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.676639 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.678608 (+ 1969us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 05:55:24.678850 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.673605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:38415 (local address 127.2.191.126:40281)
0808 05:55:24.673728 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.673731 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.673744 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:24.673872 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.673875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.673921 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.673998 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.674402 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.674915 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.675682 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.675897 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.676001 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.678734 (+ 2733us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:38415: BlockingRecv error: recv got EOF from 127.2.191.66:38415 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:24.684927 12794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.679435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:52467)
0808 05:55:24.679578 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.679594 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.679690 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.679897 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.679900 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.680062 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.680151 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.680157 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.680875 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.680878 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.681748 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.681757 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.682160 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.682164 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.682245 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.682717 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.682731 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.684710 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260808 05:55:24.684983 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.679490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:52467 (local address 127.2.191.126:40281)
0808 05:55:24.679594 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.679597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.679648 (+ 51us) server_negotiation.cc:407] Connection header received
0808 05:55:24.679767 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.679769 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.679802 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.679864 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.680259 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.680723 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.681855 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.682055 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.682139 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.684890 (+ 2751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:52467: BlockingRecv error: recv got EOF from 127.2.191.66:52467 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 05:55:24.685240 12792 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:55:24.788489 12795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:24.788817 12795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:24.788934 12795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:24.792928 12795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:24.793018 12795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:24.793140 12795 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:24.798556 12795 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33591
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/krb5kdc/oryx_127.2.191.67.keytab
--principal=oryx/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:45007
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=36883
--tserver_master_addrs=127.2.191.126:40281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:24.799721 12795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:24.800845 12795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:24.810956 12801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:24.811031 12795 server_base.cc:1034] running on GCE node
W20260808 05:55:24.810968 12804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:24.810953 12802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:24.811707 12795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:24.812378 12795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:24.813544 12795 hybrid_clock.cc:648] HybridClock initialized: now 1786168524813527 us; error 32 us; skew 500 ppm
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168524, etypes {rep=17 tkt=17 ses=17}, oryx/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:24.816584 12795 init.cc:377] Logged in from keytab as oryx/127.2.191.67@KRBTEST.COM (short username oryx)
I20260808 05:55:24.817612 12795 webserver.cc:460] Webserver started at http://127.2.191.67:36883/ using document root <none> and password file <none>
I20260808 05:55:24.818202 12795 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:24.818303 12795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:24.822511 12795 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:55:24.824606 12811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.825946 12795 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:24.826087 12795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "9a5f25eba38c42bdbeb7bb32da673357"
format_stamp: "Formatted at 2026-08-08 05:55:23 on dist-test-slave-qg60"
server_key: "a9cd233ca24fcc243db9b61d1b8b180b"
server_key_iv: "a66cd5abf8680e00ee49531022026c09"
server_key_version: "encryptionkey@0"
I20260808 05:55:24.826622 12795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:24.844797 12795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:24.847843 12795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:24.848062 12795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:24.848716 12795 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:24.849699 12795 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:24.849748 12795 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.849813 12795 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:24.849848 12795 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:24.859355 12795 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:45007
I20260808 05:55:24.859381 12936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:45007 every 8 connection(s)
I20260808 05:55:24.860469 12795 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:24.865847 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 12795
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:55:24.872615 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.862441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:33099 (local address 127.2.191.126:40281)
0808 05:55:24.862594 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.862597 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.863448 (+ 851us) server_negotiation.cc:407] Connection header received
0808 05:55:24.864843 (+ 1395us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.864846 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.864908 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.865016 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.866544 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.867281 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.868465 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.868689 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.868832 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.872477 (+ 3645us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:33099: BlockingRecv error: recv got EOF from 127.2.191.67:33099 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:55:24.873317 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.862815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:33099)
0808 05:55:24.863290 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.863337 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.864574 (+ 1237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.865212 (+ 638us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.865220 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.865664 (+ 444us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.866346 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.866363 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.867424 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.867428 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.868327 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.868336 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.868877 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.868881 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.869061 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.869739 (+ 678us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.869758 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.872368 (+ 2610us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":122,"threads_started":1}
W20260808 05:55:24.873946 12937 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:40281 (0 consecutive failures): Not authorized: Failed to ping master at 127.2.191.126:40281: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
I20260808 05:55:24.876128 12943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.866924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32906 (local address 127.2.191.126:40281)
0808 05:55:24.867198 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.867201 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.867211 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:55:24.867242 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.867244 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.867277 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.867374 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.868112 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.868639 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.869603 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.869965 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.870080 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.871447 (+ 1367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:24.871456 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:24.871475 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:24.871511 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:24.873424 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:24.874074 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:24.874080 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:24.874087 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:24.874249 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:24.874821 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:24.874824 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:24.874826 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:24.875234 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:24.875454 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:24.875715 (+ 261us) server_negotiation.cc:299] Negotiation successful
0808 05:55:24.875947 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":98,"threads_started":1}
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:24.880120 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.874472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:39819)
0808 05:55:24.874612 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.874627 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.874706 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.874986 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.874989 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.875120 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.875213 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.875217 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.876197 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.876202 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.876903 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.876912 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.877352 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.877356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.877452 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.877945 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.877956 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.880009 (+ 2053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 05:55:24.880285 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.874546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:39819 (local address 127.2.191.126:40281)
0808 05:55:24.874665 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.874669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.874682 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:24.874815 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.874818 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.874860 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.874943 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.875320 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.876054 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.877008 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.877244 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.877326 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.880137 (+ 2811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:39819: BlockingRecv error: recv got EOF from 127.2.191.67:39819 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:24 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:24.885461 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:24.880678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:39055)
0808 05:55:24.880851 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:24.880866 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:24.880952 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:24.881193 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:24.881195 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:24.881345 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:24.881413 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.881418 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.882132 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.882135 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.882650 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:24.882657 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.883111 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.883115 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:24.883198 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.883610 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:24.883621 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:24.885314 (+ 1693us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":83}
W20260808 05:55:24.885555 12645 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:24.880715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:39055 (local address 127.2.191.126:40281)
0808 05:55:24.880887 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:24.880893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:24.880909 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:55:24.881048 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:24.881051 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:24.881091 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:24.881177 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:24.881522 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.882018 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.882771 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:24.882995 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:24.883098 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:24.885434 (+ 2336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:39055: BlockingRecv error: recv got EOF from 127.2.191.67:39055 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260808 05:55:24.885843 12937 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 05:55:25 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:25 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:25.501227 12945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:25.495550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:51631)
0808 05:55:25.495831 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:25.495846 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:25.495935 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:25.496200 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:25.496202 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:25.496388 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:25.496488 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:25.496493 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.497279 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.497282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:25.497881 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:25.497890 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.498349 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.498352 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:25.498413 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:25.498983 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:25.498996 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:25.501042 (+ 2046us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":91,"threads_started":1}
W20260808 05:55:25.501334 12946 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:25.495588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:51631 (local address 127.2.191.126:40281)
0808 05:55:25.495889 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:25.495893 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:25.495906 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:25.496023 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:25.496026 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:25.496071 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:25.496162 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:25.496592 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.497172 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.497997 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.498242 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.498328 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:25.501191 (+ 2863us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:51631: BlockingRecv error: recv got EOF from 127.2.191.65:51631 (error 108)
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":120,"threads_started":1}
Aug 08 05:55:25 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:25 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:25.691128 12947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:25.685924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:56509)
0808 05:55:25.686209 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:25.686224 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:25.686328 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:25.686561 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:25.686563 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:25.686750 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:25.686848 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:25.686853 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.687576 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.687579 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:25.688165 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:25.688173 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.688585 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.688588 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:25.688648 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:25.689191 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:25.689202 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:25.690983 (+ 1781us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":96,"threads_started":1}
W20260808 05:55:25.691277 12946 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:25.685982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:56509 (local address 127.2.191.126:40281)
0808 05:55:25.686175 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:25.686180 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:25.686295 (+ 115us) server_negotiation.cc:407] Connection header received
0808 05:55:25.686409 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:25.686411 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:25.686456 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:25.686527 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:25.686946 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.687482 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.688268 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.688487 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.688566 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:25.691156 (+ 2590us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:56509: BlockingRecv error: recv got EOF from 127.2.191.66:56509 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 05:55:25 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:25 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:25.892376 12948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:25.886596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:40391)
0808 05:55:25.886895 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:25.886909 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:25.887016 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:25.887288 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:25.887290 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:25.887489 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:25.887590 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:25.887595 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.888409 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.888412 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:25.889267 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:25.889279 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.889737 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.889741 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:25.889810 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:25.890315 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:25.890326 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:25.892244 (+ 1918us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":112,"threads_started":1}
W20260808 05:55:25.892554 12946 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:25.886521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:40391 (local address 127.2.191.126:40281)
0808 05:55:25.886818 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:25.886822 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:25.886971 (+ 149us) server_negotiation.cc:407] Connection header received
0808 05:55:25.887079 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:25.887082 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:25.887129 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:25.887205 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:25.887711 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.888256 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.889393 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:25.889614 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:25.889699 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:25.892394 (+ 2695us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:40391: BlockingRecv error: recv got EOF from 127.2.191.67:40391 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 05:55:26 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:26 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:26.507473 12949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:26.502063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:53135)
0808 05:55:26.502374 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:26.502389 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:26.502495 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:26.502779 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:26.502782 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:26.502967 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:26.503073 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:26.503078 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.503824 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.503826 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:26.504404 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:26.504412 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.504853 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.504856 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:26.504914 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:26.505492 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:26.505505 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:26.507327 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":89,"threads_started":1}
W20260808 05:55:26.507653 12950 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:26.502182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:53135 (local address 127.2.191.126:40281)
0808 05:55:26.502434 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:26.502437 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:26.502450 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:26.502587 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:26.502589 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:26.502632 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:26.502711 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:26.503194 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.503729 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.504510 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.504761 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.504840 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:26.507469 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:53135: BlockingRecv error: recv got EOF from 127.2.191.65:53135 (error 108)
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":61,"threads_started":1}
Aug 08 05:55:26 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:26 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:26.697548 12951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:26.692061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:36319)
0808 05:55:26.692342 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:26.692357 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:26.692459 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:26.692711 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:26.692714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:26.692948 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:26.693049 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:26.693055 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.693780 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.693783 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:26.694350 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:26.694358 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.694792 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.694794 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:26.694852 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:26.695413 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:26.695425 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:26.697402 (+ 1977us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":98,"threads_started":1}
W20260808 05:55:26.697685 12950 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:26.692134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:36319 (local address 127.2.191.126:40281)
0808 05:55:26.692278 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:26.692282 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:26.692427 (+ 145us) server_negotiation.cc:407] Connection header received
0808 05:55:26.692544 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:26.692546 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:26.692593 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:26.692675 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:26.693162 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.693686 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.694462 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.694690 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.694774 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:26.697551 (+ 2777us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:36319: BlockingRecv error: recv got EOF from 127.2.191.66:36319 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 05:55:26 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:26 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:26.899035 12952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:26.893266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:54907)
0808 05:55:26.893613 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:26.893629 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:26.893731 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:26.894132 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:26.894134 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:26.894315 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:26.894408 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:26.894413 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.895144 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.895146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:26.895689 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:26.895695 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.896133 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.896141 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:26.896199 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:26.896791 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:26.896807 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:26.898891 (+ 2084us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":108,"threads_started":1}
W20260808 05:55:26.899154 12950 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:26.893444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:54907 (local address 127.2.191.126:40281)
0808 05:55:26.893611 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:26.893615 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:26.893698 (+ 83us) server_negotiation.cc:407] Connection header received
0808 05:55:26.893960 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:26.893963 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:26.894014 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:26.894091 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:26.894514 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.895050 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.895807 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:26.896032 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:26.896125 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:26.899033 (+ 2908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:54907: BlockingRecv error: recv got EOF from 127.2.191.67:54907 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 05:55:27 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:27 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:27.513890 12953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:27.508382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:45609)
0808 05:55:27.508695 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:27.508710 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:27.508880 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:27.509147 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:27.509149 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:27.509340 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:27.509441 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:27.509446 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.510198 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.510200 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:27.510742 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:27.510749 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.511168 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.511170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:27.511233 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:27.511729 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:27.511740 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:27.513692 (+ 1952us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":94,"threads_started":1}
W20260808 05:55:27.514039 12954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:27.508429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:45609 (local address 127.2.191.126:40281)
0808 05:55:27.508761 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:27.508764 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:27.508821 (+ 57us) server_negotiation.cc:407] Connection header received
0808 05:55:27.508977 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:27.508980 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:27.509024 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:27.509105 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:27.509546 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.510091 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.510842 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.511065 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.511152 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:27.513906 (+ 2754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:45609: BlockingRecv error: recv got EOF from 127.2.191.65:45609 (error 108)
Metrics: {"server-negotiator.queue_time_us":247,"thread_start_us":89,"threads_started":1}
Aug 08 05:55:27 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:27 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:27.703732 12955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:27.698389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:58291)
0808 05:55:27.698680 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:27.698695 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:27.698811 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:27.699038 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:27.699040 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:27.699229 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:27.699332 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:27.699337 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.700055 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.700058 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:27.700629 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:27.700637 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.701067 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.701069 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:27.701134 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:27.701731 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:27.701744 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:27.703582 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":90,"threads_started":1}
W20260808 05:55:27.703877 12954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:27.698461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:58291 (local address 127.2.191.126:40281)
0808 05:55:27.698605 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:27.698608 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:27.698772 (+ 164us) server_negotiation.cc:407] Connection header received
0808 05:55:27.698881 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:27.698883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:27.698927 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:27.698997 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:27.699433 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.699956 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.700754 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.700967 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.701046 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:27.703752 (+ 2706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:58291: BlockingRecv error: recv got EOF from 127.2.191.66:58291 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 05:55:27 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:27 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:27.905598 12956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:27.899917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:52435)
0808 05:55:27.900200 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:27.900223 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:27.900323 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:27.900568 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:27.900571 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:27.900807 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:27.900960 (+ 153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:27.900973 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.901777 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.901779 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:27.902356 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:27.902365 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.902815 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.902818 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:27.902881 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:27.903405 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:27.903417 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:27.905475 (+ 2058us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":96,"threads_started":1}
W20260808 05:55:27.906020 12954 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:27.900040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:52435 (local address 127.2.191.126:40281)
0808 05:55:27.900231 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:27.900234 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:27.900274 (+ 40us) server_negotiation.cc:407] Connection header received
0808 05:55:27.900404 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:27.900406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:27.900454 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:27.900527 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:27.901106 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.901673 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.902467 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:27.902708 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:27.902791 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:27.905821 (+ 3030us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:52435: BlockingRecv error: recv got EOF from 127.2.191.67:52435 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
Aug 08 05:55:28 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:28 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:28.525532 12957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:28.514761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:35043)
0808 05:55:28.515079 (+ 318us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:28.515095 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:28.515197 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:28.515440 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:28.515442 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:28.515630 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:28.515731 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:28.515737 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.516534 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.516536 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:28.517189 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:28.517198 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.517611 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.517614 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:28.517675 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:28.523294 (+ 5619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:28.523311 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:28.525411 (+ 2100us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":95,"threads_started":1}
W20260808 05:55:28.525713 12958 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:28.514903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:35043 (local address 127.2.191.126:40281)
0808 05:55:28.515180 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:28.515184 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:28.515198 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:28.515282 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:28.515284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:28.515326 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:28.515406 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:28.515862 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.516435 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.517292 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.517510 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.517593 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:28.525565 (+ 7972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:35043: BlockingRecv error: recv got EOF from 127.2.191.65:35043 (error 108)
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":98,"threads_started":1}
Aug 08 05:55:28 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:28 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:28.710438 12959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:28.704667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:37907)
0808 05:55:28.704981 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:28.704996 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:28.705096 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:28.705401 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:28.705403 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:28.705590 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:28.705687 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:28.705693 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.706415 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.706417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:28.706958 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:28.706965 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.707414 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.707418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:28.707491 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:28.708014 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:28.708026 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:28.710277 (+ 2251us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":135,"threads_started":1}
W20260808 05:55:28.710556 12958 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:28.704752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:37907 (local address 127.2.191.126:40281)
0808 05:55:28.704932 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:28.704936 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:28.705064 (+ 128us) server_negotiation.cc:407] Connection header received
0808 05:55:28.705236 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:28.705238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:28.705289 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:28.705364 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:28.705790 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.706320 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.707055 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.707275 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.707360 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:28.710441 (+ 3081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:37907: BlockingRecv error: recv got EOF from 127.2.191.66:37907 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 05:55:28 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:28 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:28.912693 12960 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:28.906547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:45081)
0808 05:55:28.906843 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:28.906867 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:28.906991 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:28.907269 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:28.907271 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:28.907453 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:28.907549 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:28.907554 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.908375 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.908378 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:28.908999 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:28.909009 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.909502 (+ 493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.909504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:28.909570 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:28.910330 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:28.910343 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:28.912545 (+ 2202us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":115,"threads_started":1}
W20260808 05:55:28.912930 12958 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:28.906628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:45081 (local address 127.2.191.126:40281)
0808 05:55:28.906904 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:28.906908 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:28.906946 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:55:28.907089 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:28.907091 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:28.907145 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:28.907235 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:28.907685 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.908247 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.909138 (+ 891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:28.909382 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:28.909473 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:28.912781 (+ 3308us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:45081: BlockingRecv error: recv got EOF from 127.2.191.67:45081 (error 108)
Metrics: {"server-negotiator.queue_time_us":144}
Aug 08 05:55:29 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:29 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:29.532492 12961 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:29.526602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:51767)
0808 05:55:29.526907 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:29.526927 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:29.527035 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:29.527343 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:29.527346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:29.527537 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:29.527659 (+ 122us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:29.527665 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.528455 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.528458 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:29.529127 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:29.529138 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.529565 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.529567 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:29.529640 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:29.530251 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:29.530263 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:29.532374 (+ 2111us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":116,"threads_started":1}
W20260808 05:55:29.532714 12962 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:29.526702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:51767 (local address 127.2.191.126:40281)
0808 05:55:29.526942 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:29.526945 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:29.526980 (+ 35us) server_negotiation.cc:407] Connection header received
0808 05:55:29.527146 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:29.527148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:29.527192 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:29.527277 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:29.527796 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.528348 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.529241 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.529463 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.529547 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:29.532513 (+ 2966us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:51767: BlockingRecv error: recv got EOF from 127.2.191.65:51767 (error 108)
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":92,"threads_started":1}
Aug 08 05:55:29 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:29 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:29.717279 12963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:29.711369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:54537)
0808 05:55:29.711716 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:29.711732 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:29.711838 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:29.712100 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:29.712102 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:29.712308 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:29.712415 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:29.712421 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.713276 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.713279 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:29.713920 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:29.713933 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.714445 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.714447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:29.714519 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:29.715073 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:29.715086 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:29.717117 (+ 2031us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":95,"threads_started":1}
W20260808 05:55:29.717406 12962 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:29.711599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:54537 (local address 127.2.191.126:40281)
0808 05:55:29.711746 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:29.711750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:29.711787 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:55:29.711930 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:29.711932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:29.711974 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:29.712042 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:29.712520 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.713146 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.714119 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.714340 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.714423 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:29.717292 (+ 2869us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:54537: BlockingRecv error: recv got EOF from 127.2.191.66:54537 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 05:55:29 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:29 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:29.919221 12964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:29.913722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:46933)
0808 05:55:29.914016 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:29.914031 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:29.914128 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:29.914396 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:29.914398 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:29.914611 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:29.914708 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:29.914714 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.915477 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.915479 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:29.916073 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:29.916082 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.916511 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.916513 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:29.916577 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:29.917213 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:29.917225 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:29.919089 (+ 1864us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":122,"threads_started":1}
W20260808 05:55:29.919410 12962 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:29.913828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:46933 (local address 127.2.191.126:40281)
0808 05:55:29.913977 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:29.913981 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:29.914096 (+ 115us) server_negotiation.cc:407] Connection header received
0808 05:55:29.914207 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:29.914211 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:29.914269 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:29.914360 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:29.914810 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.915363 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.916183 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:29.916399 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:29.916481 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:29.919243 (+ 2762us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:46933: BlockingRecv error: recv got EOF from 127.2.191.67:46933 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 05:55:30 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:30 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:30.539186 12966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:30.533359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:39859)
0808 05:55:30.533651 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:30.533667 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:30.533766 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:30.534006 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:30.534008 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:30.534213 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:30.534313 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:30.534318 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.535058 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.535060 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:30.535837 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:30.535851 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.536436 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.536439 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:30.536528 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:30.537095 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:30.537117 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:30.539059 (+ 1942us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":93,"threads_started":1}
W20260808 05:55:30.539400 12967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:30.533445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:39859 (local address 127.2.191.126:40281)
0808 05:55:30.533747 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:30.533751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:30.533765 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:30.533851 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:30.533853 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:30.533894 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:30.533973 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:30.534417 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.534957 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.535971 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.536297 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.536412 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:30.539242 (+ 2830us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:39859: BlockingRecv error: recv got EOF from 127.2.191.65:39859 (error 108)
Metrics: {"server-negotiator.queue_time_us":233,"thread_start_us":86,"threads_started":1}
Aug 08 05:55:30 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:30 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:30.723994 12968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:30.718375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:50535)
0808 05:55:30.718685 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:30.718700 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:30.718802 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:30.719034 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:30.719036 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:30.719228 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:30.719323 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:30.719329 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.720051 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.720053 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:30.720611 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:30.720618 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.721118 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.721120 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:30.721186 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:30.721770 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:30.721783 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:30.723835 (+ 2052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":127,"threads_started":1}
W20260808 05:55:30.724278 12967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:30.718485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:50535 (local address 127.2.191.126:40281)
0808 05:55:30.718625 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:30.718628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:30.718772 (+ 144us) server_negotiation.cc:407] Connection header received
0808 05:55:30.718881 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:30.718883 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:30.718928 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:30.719001 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:30.719422 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.719949 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.720776 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.721005 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.721091 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:30.724021 (+ 2930us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:50535: BlockingRecv error: recv got EOF from 127.2.191.66:50535 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 05:55:30 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:30 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:30.926460 12969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:30.920051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:57107)
0808 05:55:30.920415 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:30.920433 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:30.920577 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:30.920889 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:30.920892 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:30.921192 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:30.921349 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:30.921357 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.922154 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.922160 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:30.922793 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:30.922802 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.923302 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.923305 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:30.923403 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:30.924005 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:30.924018 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:30.926282 (+ 2264us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":113,"threads_started":1}
W20260808 05:55:30.926559 12967 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:30.920239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:57107 (local address 127.2.191.126:40281)
0808 05:55:30.920395 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:30.920400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:30.920545 (+ 145us) server_negotiation.cc:407] Connection header received
0808 05:55:30.920700 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:30.920703 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:30.920780 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:30.920866 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:30.921480 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.922038 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.922932 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:30.923180 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:30.923295 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:30.926418 (+ 3123us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:57107: BlockingRecv error: recv got EOF from 127.2.191.67:57107 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 05:55:31 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:31 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:31.545625 12970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:31.540006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:42113)
0808 05:55:31.540340 (+ 334us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:31.540354 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:31.540461 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:31.540704 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:31.540706 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:31.540916 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:31.541016 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:31.541021 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.541810 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.541813 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:31.542395 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:31.542403 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.542963 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.542971 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:31.543078 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:31.543598 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:31.543613 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:31.545499 (+ 1886us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":80,"threads_started":1}
W20260808 05:55:31.546141 12971 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:31.540065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:42113 (local address 127.2.191.126:40281)
0808 05:55:31.540354 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:31.540357 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:31.540426 (+ 69us) server_negotiation.cc:407] Connection header received
0808 05:55:31.540541 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:31.540543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:31.540588 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:31.540668 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:31.541147 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.541701 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.542501 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.542763 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.542880 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:31.545677 (+ 2797us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:42113: BlockingRecv error: recv got EOF from 127.2.191.65:42113 (error 108)
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":101,"threads_started":1}
Aug 08 05:55:31 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:31 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:31.730455 12972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:31.724807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:60965)
0808 05:55:31.725139 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:31.725158 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:31.725274 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:31.725481 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:31.725503 (+ 22us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:31.725693 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:31.725792 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:31.725797 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.726606 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.726609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:31.727190 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:31.727199 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.727689 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.727693 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:31.727763 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:31.728260 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:31.728271 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:31.730318 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":167,"threads_started":1}
W20260808 05:55:31.730603 12971 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:31.724856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:60965 (local address 127.2.191.126:40281)
0808 05:55:31.725001 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:31.725005 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:31.725237 (+ 232us) server_negotiation.cc:407] Connection header received
0808 05:55:31.725352 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:31.725354 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:31.725398 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:31.725468 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:31.725930 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.726495 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.727312 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.727553 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.727641 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:31.730465 (+ 2824us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:60965: BlockingRecv error: recv got EOF from 127.2.191.66:60965 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 08 05:55:31 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:31 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:31.933208 12973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:31.927457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:44537)
0808 05:55:31.927841 (+ 384us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:31.927857 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:31.927970 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:31.928211 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:31.928214 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:31.928403 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:31.928501 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:31.928506 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.929313 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.929316 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:31.929899 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:31.929907 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.930413 (+ 506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.930416 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:31.930480 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:31.930974 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:31.930986 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:31.932987 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":136,"threads_started":1}
W20260808 05:55:31.933282 12971 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:31.927550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:44537 (local address 127.2.191.126:40281)
0808 05:55:31.927749 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:31.927754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:31.927920 (+ 166us) server_negotiation.cc:407] Connection header received
0808 05:55:31.928046 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:31.928048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:31.928097 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:31.928174 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:31.928624 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.929199 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.930007 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:31.930298 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:31.930378 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:31.933151 (+ 2773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:44537: BlockingRecv error: recv got EOF from 127.2.191.67:44537 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 08 05:55:32 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:32 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:32.552520 12974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:32.546574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:36479)
0808 05:55:32.546904 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:32.546929 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:32.547022 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:32.547274 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:32.547276 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:32.547467 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:32.547564 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:32.547569 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.548407 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.548410 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:32.549070 (+ 660us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:32.549083 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.549793 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.549796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:32.549864 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:32.550407 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:32.550420 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:32.552398 (+ 1978us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":98,"threads_started":1}
W20260808 05:55:32.552753 12975 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:32.546759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:36479 (local address 127.2.191.126:40281)
0808 05:55:32.547002 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:32.547006 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:32.547019 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:32.547108 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:32.547111 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:32.547154 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:32.547235 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:32.547699 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.548285 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.549208 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.549619 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.549715 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:32.552546 (+ 2831us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:36479: BlockingRecv error: recv got EOF from 127.2.191.65:36479 (error 108)
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":79,"threads_started":1}
Aug 08 05:55:32 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:32 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:32.737780 12976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:32.731357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:52697)
0808 05:55:32.731696 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:32.731717 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:32.731866 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:32.732171 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:32.732175 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:32.732422 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:32.732534 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:32.732541 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.733636 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.733643 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:32.734355 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:32.734365 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.734884 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.734888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:32.734995 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:32.735502 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:32.735514 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:32.737573 (+ 2059us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":115,"threads_started":1}
W20260808 05:55:32.737828 12975 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:32.731393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:52697 (local address 127.2.191.126:40281)
0808 05:55:32.731571 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:32.731577 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:32.731803 (+ 226us) server_negotiation.cc:407] Connection header received
0808 05:55:32.731983 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:32.731988 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:32.732048 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:32.732144 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:32.732669 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.733508 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.734500 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.734760 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.734882 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:32.737714 (+ 2832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:52697: BlockingRecv error: recv got EOF from 127.2.191.66:52697 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 05:55:32 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:32 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:32.939798 12977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:32.934005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:55219)
0808 05:55:32.934308 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:32.934324 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:32.934428 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:32.934733 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:32.934736 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:32.934923 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:32.935025 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:32.935030 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.935845 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.935848 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:32.936415 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:32.936423 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.936936 (+ 513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.936938 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:32.937004 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:32.937693 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:32.937705 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:32.939675 (+ 1970us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":83,"threads_started":1}
W20260808 05:55:32.940132 12975 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:32.934170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:55219 (local address 127.2.191.126:40281)
0808 05:55:32.934353 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:32.934357 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:32.934375 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:55:32.934527 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:32.934530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:32.934580 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:32.934657 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:32.935156 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.935737 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.936547 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:32.936817 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:32.936911 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:32.939912 (+ 3001us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:55219: BlockingRecv error: recv got EOF from 127.2.191.67:55219 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 05:55:33 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:33 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:33.564404 12978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:33.553445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:46135)
0808 05:55:33.553796 (+ 351us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:33.553816 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:33.554014 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:33.554335 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:33.554338 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:33.554559 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:33.554667 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:33.554673 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.555681 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.555683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:33.556269 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:33.556278 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.556824 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.556829 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:33.556901 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:33.562072 (+ 5171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:33.562086 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:33.564194 (+ 2108us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":88,"threads_started":1}
W20260808 05:55:33.564484 12979 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:33.553665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:46135 (local address 127.2.191.126:40281)
0808 05:55:33.553945 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:33.554031 (+ 86us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:33.554049 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:55:33.554105 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:33.554107 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:33.554154 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:33.554248 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:33.554816 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.555550 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.556408 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.556649 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.556815 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:33.564348 (+ 7533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:46135: BlockingRecv error: recv got EOF from 127.2.191.65:46135 (error 108)
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":83,"threads_started":1}
Aug 08 05:55:33 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:33 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:33.745859 12980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:33.738866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:58167)
0808 05:55:33.739216 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:33.739234 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:33.739379 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:33.739745 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:33.739749 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:33.740069 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:33.740180 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:33.740187 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.741288 (+ 1101us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.741295 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:33.741914 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:33.741935 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.742556 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.742560 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:33.742661 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:33.743348 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:33.743362 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:33.745704 (+ 2342us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":87,"threads_started":1}
W20260808 05:55:33.746204 12979 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:33.738982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:58167 (local address 127.2.191.126:40281)
0808 05:55:33.739226 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:33.739231 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:33.739322 (+ 91us) server_negotiation.cc:407] Connection header received
0808 05:55:33.739492 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:33.739496 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:33.739561 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:33.739668 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:33.740329 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.741166 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.742078 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.742412 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.742547 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:33.745880 (+ 3333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:58167: BlockingRecv error: recv got EOF from 127.2.191.66:58167 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
Aug 08 05:55:33 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:33 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:33.948312 12981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:33.940701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:57185)
0808 05:55:33.941038 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:33.941060 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:33.941202 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:33.941551 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:33.941554 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:33.941824 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:33.941967 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:33.941976 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.943242 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.943245 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:33.943952 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:33.943969 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.944545 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.944548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:33.944637 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:33.945514 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:33.945531 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:33.948063 (+ 2532us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":103,"threads_started":1}
W20260808 05:55:33.948552 12979 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:33.940788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:57185 (local address 127.2.191.126:40281)
0808 05:55:33.940956 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:33.940961 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:33.941140 (+ 179us) server_negotiation.cc:407] Connection header received
0808 05:55:33.941328 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:33.941332 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:33.941394 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:33.941486 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:33.942108 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.942962 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.944071 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:33.944402 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:33.944537 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:33.948405 (+ 3868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:57185: BlockingRecv error: recv got EOF from 127.2.191.67:57185 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 08 05:55:34 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:34 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:34.570889 12982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:34.565270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:55929)
0808 05:55:34.565610 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:34.565625 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:34.565726 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:34.565990 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:34.565992 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:34.566199 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:34.566302 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:34.566308 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.567064 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.567067 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:34.567635 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:34.567643 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.568079 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.568082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:34.568145 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:34.568796 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:34.568815 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:34.570766 (+ 1951us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":94,"threads_started":1}
W20260808 05:55:34.571059 12983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:34.565395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:55929 (local address 127.2.191.126:40281)
0808 05:55:34.565637 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:34.565641 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:34.565685 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:55:34.565822 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:34.565825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:34.565868 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:34.565947 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:34.566414 (+ 467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.566949 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.567748 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.567973 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.568056 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:34.570921 (+ 2865us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:55929: BlockingRecv error: recv got EOF from 127.2.191.65:55929 (error 108)
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":63,"threads_started":1}
Aug 08 05:55:34 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:34 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:34.753917 12984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:34.746721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:60689)
0808 05:55:34.747020 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:34.747034 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:34.747136 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:34.747491 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:34.747494 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:34.747827 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:34.747974 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:34.747983 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.749115 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.749119 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:34.750106 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:34.750120 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.750733 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.750736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:34.750824 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:34.751487 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:34.751504 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:34.753798 (+ 2294us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":84,"threads_started":1}
W20260808 05:55:34.754058 12983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:34.746803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:60689 (local address 127.2.191.126:40281)
0808 05:55:34.746974 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:34.746979 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:34.747122 (+ 143us) server_negotiation.cc:407] Connection header received
0808 05:55:34.747236 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:34.747241 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:34.747310 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:34.747407 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:34.748123 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.748999 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.750242 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.750596 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.750724 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:34.753936 (+ 3212us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:60689: BlockingRecv error: recv got EOF from 127.2.191.66:60689 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 05:55:34 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:34 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:34.955215 12985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:34.949462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:51419)
0808 05:55:34.949844 (+ 382us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:34.949862 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:34.950003 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:34.950318 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:34.950321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:34.950537 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:34.950641 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:34.950647 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.951550 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.951555 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:34.952126 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:34.952134 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.952592 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.952596 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:34.952690 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:34.953221 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:34.953232 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:34.955053 (+ 1821us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":228,"threads_started":1}
W20260808 05:55:34.955340 12983 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:34.949623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:51419 (local address 127.2.191.126:40281)
0808 05:55:34.949795 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:34.949800 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:34.949952 (+ 152us) server_negotiation.cc:407] Connection header received
0808 05:55:34.950127 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:34.950132 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:34.950194 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:34.950287 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:34.950768 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.951436 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.952250 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:34.952474 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:34.952587 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:34.955227 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:51419: BlockingRecv error: recv got EOF from 127.2.191.67:51419 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 05:55:35 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:35 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:35.577591 12986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:35.571786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:45691)
0808 05:55:35.572124 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:35.572140 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:35.572238 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:35.572484 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:35.572486 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:35.572678 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:35.572813 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:35.572819 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.573652 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.573655 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:35.574216 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:35.574225 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.574706 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.574710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:35.574795 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:35.575437 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:35.575450 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:35.577400 (+ 1950us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":98,"threads_started":1}
W20260808 05:55:35.577672 12987 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:35.571868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:45691 (local address 127.2.191.126:40281)
0808 05:55:35.572181 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:35.572184 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:35.572198 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:35.572316 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:35.572318 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:35.572360 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:35.572439 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:35.572924 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.573499 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.574346 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.574581 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.574697 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:35.577539 (+ 2842us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:45691: BlockingRecv error: recv got EOF from 127.2.191.65:45691 (error 108)
Metrics: {"server-negotiator.queue_time_us":241,"thread_start_us":74,"threads_started":1}
Aug 08 05:55:35 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:35 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:35.760922 12989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:35.754958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:37391)
0808 05:55:35.755324 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:35.755340 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:35.755488 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:35.755802 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:35.755805 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:35.756024 (+ 219us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:35.756149 (+ 125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:35.756155 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.757072 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.757077 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:35.757661 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:35.757669 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.758143 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.758147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:35.758234 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:35.758753 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:35.758765 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:35.760802 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":116,"threads_started":1}
W20260808 05:55:35.761052 12987 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:35.755093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:37391 (local address 127.2.191.126:40281)
0808 05:55:35.755276 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:35.755280 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:35.755422 (+ 142us) server_negotiation.cc:407] Connection header received
0808 05:55:35.755596 (+ 174us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:35.755632 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:35.755682 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:35.755776 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:35.756278 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.756959 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.757788 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.758016 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.758130 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:35.760936 (+ 2806us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:37391: BlockingRecv error: recv got EOF from 127.2.191.66:37391 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 08 05:55:35 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:35 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:35.962234 12990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:35.956192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:49793)
0808 05:55:35.956534 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:35.956549 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:35.956700 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:35.957043 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:35.957046 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:35.957292 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:35.957434 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:35.957441 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.958394 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.958397 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:35.958977 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:35.958986 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.959460 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.959463 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:35.959560 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:35.960083 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:35.960095 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:35.962087 (+ 1992us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":88,"threads_started":1}
W20260808 05:55:35.962353 12987 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:35.956329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:49793 (local address 127.2.191.126:40281)
0808 05:55:35.956502 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:35.956507 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:35.956663 (+ 156us) server_negotiation.cc:407] Connection header received
0808 05:55:35.956839 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:35.956842 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:35.956902 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:35.956999 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:35.957576 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.958282 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.959101 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:35.959312 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:35.959392 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:35.962253 (+ 2861us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:49793: BlockingRecv error: recv got EOF from 127.2.191.67:49793 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 05:55:36 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:36 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:36.583873 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:36.578503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:32795)
0808 05:55:36.578830 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:36.578845 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:36.578950 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:36.579211 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:36.579213 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:36.579393 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:36.579491 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:36.579496 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.580266 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.580268 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:36.580889 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:36.580898 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.581337 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.581340 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:36.581399 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:36.581881 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:36.581892 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:36.583750 (+ 1858us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":103,"threads_started":1}
W20260808 05:55:36.584034 12992 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:36.578558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:32795 (local address 127.2.191.126:40281)
0808 05:55:36.578848 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:36.578852 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:36.578921 (+ 69us) server_negotiation.cc:407] Connection header received
0808 05:55:36.579035 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:36.579037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:36.579088 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:36.579166 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:36.579605 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.580168 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.580995 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.581235 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.581317 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:36.583896 (+ 2579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:32795: BlockingRecv error: recv got EOF from 127.2.191.65:32795 (error 108)
Metrics: {"server-negotiator.queue_time_us":218,"thread_start_us":103,"threads_started":1}
Aug 08 05:55:36 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:36 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:36.767668 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:36.761885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:58903)
0808 05:55:36.762189 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:36.762205 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:36.762350 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:36.762657 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:36.762659 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:36.762869 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:36.762961 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:36.762967 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.763808 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.763812 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:36.764408 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:36.764418 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.765028 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.765031 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:36.765098 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:36.765624 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:36.765636 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:36.767526 (+ 1890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":95,"threads_started":1}
W20260808 05:55:36.767855 12992 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:36.761958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:58903 (local address 127.2.191.126:40281)
0808 05:55:36.762166 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:36.762171 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:36.762289 (+ 118us) server_negotiation.cc:407] Connection header received
0808 05:55:36.762468 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:36.762476 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:36.762524 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:36.762611 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:36.763082 (+ 471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.763680 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.764534 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.764914 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.765008 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:36.767713 (+ 2705us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:58903: BlockingRecv error: recv got EOF from 127.2.191.66:58903 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 05:55:36 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:36 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:36.969033 12994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:36.963276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:41537)
0808 05:55:36.963628 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:36.963642 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:36.963786 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:36.964066 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:36.964069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:36.964304 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:36.964399 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:36.964404 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.965317 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.965322 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:36.965883 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:36.965891 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.966354 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.966357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:36.966443 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:36.967014 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:36.967026 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:36.968842 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":114,"threads_started":1}
W20260808 05:55:36.969146 12992 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:36.963352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:41537 (local address 127.2.191.126:40281)
0808 05:55:36.963535 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:36.963540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:36.963727 (+ 187us) server_negotiation.cc:407] Connection header received
0808 05:55:36.963890 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:36.963893 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:36.963949 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:36.964040 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:36.964524 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.965204 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.966006 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:36.966242 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:36.966349 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:36.968991 (+ 2642us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:41537: BlockingRecv error: recv got EOF from 127.2.191.67:41537 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 08 05:55:37 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:37 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:37.591007 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:37.584909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:39233)
0808 05:55:37.585210 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:37.585226 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:37.585320 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:37.585619 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:37.585621 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:37.585814 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:37.585911 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:37.585916 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.586680 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.586683 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:37.587293 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:37.587302 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.587775 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.587777 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:37.587843 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:37.588371 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:37.588383 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:37.590813 (+ 2430us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":220,"thread_start_us":96,"threads_started":1}
W20260808 05:55:37.591094 12996 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:37.584973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:39233 (local address 127.2.191.126:40281)
0808 05:55:37.585248 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:37.585252 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:37.585270 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:55:37.585424 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:37.585426 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:37.585473 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:37.585556 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:37.586018 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.586551 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.587411 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.587653 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.587734 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:37.590948 (+ 3214us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:39233: BlockingRecv error: recv got EOF from 127.2.191.65:39233 (error 108)
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":70,"threads_started":1}
Aug 08 05:55:37 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:37 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:37.774349 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:37.768463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:56531)
0808 05:55:37.768820 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:37.768839 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:37.768964 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:37.769325 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:37.769328 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:37.769558 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:37.769653 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:37.769659 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.770486 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.770490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:37.771095 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:37.771104 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.771635 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.771639 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:37.771732 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:37.772254 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:37.772266 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:37.774210 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":136,"threads_started":1}
W20260808 05:55:37.774533 12996 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:37.768647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:56531 (local address 127.2.191.126:40281)
0808 05:55:37.768823 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:37.768829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:37.768895 (+ 66us) server_negotiation.cc:407] Connection header received
0808 05:55:37.769139 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:37.769143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:37.769203 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:37.769299 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:37.769782 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.770364 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.771224 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.771499 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.771624 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:37.774367 (+ 2743us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:56531: BlockingRecv error: recv got EOF from 127.2.191.66:56531 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 05:55:37 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:37 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:37.975543 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:37.969850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:46191)
0808 05:55:37.970147 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:37.970162 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:37.970263 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:37.970541 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:37.970544 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:37.970737 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:37.970838 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:37.970844 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.971620 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.971622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:37.972266 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:37.972275 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.972772 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.972775 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:37.972842 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:37.973410 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:37.973422 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:37.975346 (+ 1924us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":95,"threads_started":1}
W20260808 05:55:37.975584 12996 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:37.969931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:46191 (local address 127.2.191.126:40281)
0808 05:55:37.970061 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:37.970064 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:37.970228 (+ 164us) server_negotiation.cc:407] Connection header received
0808 05:55:37.970340 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:37.970342 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:37.970388 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:37.970457 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:37.970957 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.971511 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.972382 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:37.972630 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:37.972711 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:37.975475 (+ 2764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:46191: BlockingRecv error: recv got EOF from 127.2.191.67:46191 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 08 05:55:38 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:38 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:38.602659 12999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:38.591979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:55909)
0808 05:55:38.592306 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:38.592320 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:38.592413 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:38.592631 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:38.592633 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:38.592856 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:38.592955 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:38.592960 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.593724 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.593727 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:38.594380 (+ 653us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:38.594389 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.594825 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.594828 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:38.594889 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:38.600060 (+ 5171us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:38.600074 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:38.602496 (+ 2422us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":112,"threads_started":1}
W20260808 05:55:38.602823 13000 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:38.592081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:55909 (local address 127.2.191.126:40281)
0808 05:55:38.592415 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:38.592419 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:38.592432 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:55:38.592473 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:38.592475 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:38.592518 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:38.592603 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:38.593069 (+ 466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.593623 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.594488 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.594726 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.594806 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:38.602654 (+ 7848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:55909: BlockingRecv error: recv got EOF from 127.2.191.65:55909 (error 108)
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":78,"threads_started":1}
Aug 08 05:55:38 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:38 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:38.781371 13001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:38.775249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:42501)
0808 05:55:38.775620 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:38.775634 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:38.775768 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:38.776073 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:38.776076 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:38.776302 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:38.776397 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:38.776402 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.777278 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.777284 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:38.777866 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:38.777874 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.778362 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.778366 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:38.778446 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:38.779033 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:38.779054 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:38.781166 (+ 2112us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":78,"threads_started":1}
W20260808 05:55:38.781477 13000 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:38.775356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:42501 (local address 127.2.191.126:40281)
0808 05:55:38.775512 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:38.775516 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:38.775708 (+ 192us) server_negotiation.cc:407] Connection header received
0808 05:55:38.775885 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:38.775888 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:38.775948 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:38.776037 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:38.776517 (+ 480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.777167 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.777991 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.778243 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.778375 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:38.781335 (+ 2960us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:42501: BlockingRecv error: recv got EOF from 127.2.191.66:42501 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 08 05:55:38 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:38 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.67@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:38.986995 13002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:38.976694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.67:48375)
0808 05:55:38.977237 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:38.977252 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:38.977397 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:38.978057 (+ 660us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:38.978060 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:38.978423 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:38.978574 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:38.978613 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.979963 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.979970 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:38.980887 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:38.980905 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.981807 (+ 902us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.981830 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:38.982015 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:38.982947 (+ 932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:38.982971 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:38.986523 (+ 3552us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":173,"threads_started":1}
W20260808 05:55:38.987120 13000 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:38.976931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:48375 (local address 127.2.191.126:40281)
0808 05:55:38.977169 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:38.977175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:38.977350 (+ 175us) server_negotiation.cc:407] Connection header received
0808 05:55:38.977777 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:38.977781 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:38.977866 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:38.977983 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:38.978828 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.979695 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.981113 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:38.981492 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:38.981796 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:38.986843 (+ 5047us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.67:48375: BlockingRecv error: recv got EOF from 127.2.191.67:48375 (error 108)
Metrics: {"server-negotiator.queue_time_us":84}
Aug 08 05:55:39 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:39 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.65@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:39.616286 13003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:39.604206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.65:37025)
0808 05:55:39.604695 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:39.604811 (+ 116us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:39.605111 (+ 300us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:39.605751 (+ 640us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:39.605754 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:39.605958 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:39.606124 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:39.606143 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:39.607907 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:39.607918 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:39.609153 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:39.609180 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:39.610343 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:39.610355 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:39.610467 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:39.611625 (+ 1158us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:39.611665 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:39.616030 (+ 4365us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":321,"thread_start_us":158,"threads_started":1}
W20260808 05:55:39.616791 13004 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:39.604274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:37025 (local address 127.2.191.126:40281)
0808 05:55:39.604908 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:39.604916 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:39.605004 (+ 88us) server_negotiation.cc:407] Connection header received
0808 05:55:39.605278 (+ 274us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:39.605281 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:39.605504 (+ 223us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:39.605683 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:39.606373 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:39.607693 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:39.609399 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:39.610037 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:39.610308 (+ 271us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:39.616437 (+ 6129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.65:37025: BlockingRecv error: recv got EOF from 127.2.191.65:37025 (error 108)
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":180,"threads_started":1}
Aug 08 05:55:39 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:55:39 dist-test-slave-qg60 krb5kdc[11820](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.2.191.66@KRBTEST.COM for oryx/127.2.191.126@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:55:39.796186 13005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:39.783537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40281 (local address 127.2.191.66:37489)
0808 05:55:39.784275 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:39.784324 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:39.784569 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:39.785345 (+ 776us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:39.785362 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:39.786031 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:39.786410 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:39.786440 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:39.788120 (+ 1680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:39.788132 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:39.789260 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:39.789275 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:39.790152 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:39.790157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:39.790320 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:39.791488 (+ 1168us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:39.791531 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:39.795966 (+ 4435us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.2.191.126:40281: Server oryx/127.2.191.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":563,"thread_start_us":307,"threads_started":1}
W20260808 05:55:39.796499 13004 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:39.783703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:37489 (local address 127.2.191.126:40281)
0808 05:55:39.784337 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:39.784349 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:39.784547 (+ 198us) server_negotiation.cc:407] Connection header received
0808 05:55:39.784818 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:39.784822 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:39.785024 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:39.785226 (+ 202us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:39.786658 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:39.787734 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:39.789463 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:39.789936 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:39.790091 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:39.796215 (+ 6124us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.2.191.66:37489: BlockingRecv error: recv got EOF from 127.2.191.66:37489 (error 108)
Metrics: {"server-negotiator.queue_time_us":244}
I20260808 05:55:39.875957 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 12478
I20260808 05:55:39.901991 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 12647
I20260808 05:55:39.930987 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 12795
I20260808 05:55:39.947463 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 12399
2026-08-08T05:55:39Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (18240 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T05:55:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:39Z Disabled control of system clock
I20260808 05:55:39.997470 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:35961
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:33493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:35961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 05:55:40.114527 13009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:40.114809 13009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:40.114845 13009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:40.118911 13009 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:40.118978 13009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:40.118993 13009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:40.119010 13009 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:40.119026 13009 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:40.123947 13009 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:35961
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:35961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:40.125198 13009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:40.126614 13009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:40.135618 13016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:40.135644 13015 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:40.135630 13018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:40.136075 13009 server_base.cc:1034] running on GCE node
I20260808 05:55:40.136685 13009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:40.137912 13009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:40.139103 13009 hybrid_clock.cc:648] HybridClock initialized: now 1786168540139090 us; error 38 us; skew 500 ppm
I20260808 05:55:40.141039 13009 webserver.cc:460] Webserver started at http://127.2.191.126:34575/ using document root <none> and password file <none>
I20260808 05:55:40.141610 13009 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:40.141672 13009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:40.141840 13009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:40.144025 13009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "d57de620ef1548468cdf7ec700eae99c"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "71bcd0523755986c53c0865ca6eaef8c"
server_key_iv: "0e4134eb5462afea9b13a223d60e604d"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.144577 13009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "d57de620ef1548468cdf7ec700eae99c"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "71bcd0523755986c53c0865ca6eaef8c"
server_key_iv: "0e4134eb5462afea9b13a223d60e604d"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.148394 13009 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 05:55:40.151018 13025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.152309 13009 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:55:40.152452 13009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "d57de620ef1548468cdf7ec700eae99c"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "71bcd0523755986c53c0865ca6eaef8c"
server_key_iv: "0e4134eb5462afea9b13a223d60e604d"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.152578 13009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:40.166324 13009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:40.167078 13009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:40.167291 13009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:40.174985 13009 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:35961
I20260808 05:55:40.174995 13085 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:35961 every 8 connection(s)
I20260808 05:55:40.175995 13009 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:40.178956 13086 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:40.184083 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 13009
I20260808 05:55:40.184247 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:40.184535 2813 external_mini_cluster.cc:1428] Setting key 5b96fa781d7fb24679eaac768cc0c5a6
I20260808 05:55:40.184902 13086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c: Bootstrap starting.
I20260808 05:55:40.187494 13086 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:40.188391 13086 log.cc:824] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:40.190544 13086 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c: No bootstrap required, opened a new log
I20260808 05:55:40.194233 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:40.186121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37024 (local address 127.2.191.126:35961)
0808 05:55:40.186780 (+ 659us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:40.186795 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:40.186833 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:55:40.187470 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:40.187488 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:40.187948 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:40.188240 (+ 292us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:40.188650 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.189681 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.190869 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.191336 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.191456 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:40.192348 (+ 892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:40.192353 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:40.192365 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:40.192840 (+ 475us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:40.192900 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:40.192921 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:40.192997 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:40.193156 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 05:55:40.193455 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":147,"threads_started":1}
I20260808 05:55:40.194741 13086 raft_consensus.cc:348] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57de620ef1548468cdf7ec700eae99c" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35961 } }
I20260808 05:55:40.194957 13086 raft_consensus.cc:374] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:40.195014 13086 raft_consensus.cc:729] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d57de620ef1548468cdf7ec700eae99c, State: Initialized, Role: FOLLOWER
I20260808 05:55:40.195479 13086 consensus_queue.cc:260] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57de620ef1548468cdf7ec700eae99c" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35961 } }
I20260808 05:55:40.195644 13086 raft_consensus.cc:388] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:40.195725 13086 raft_consensus.cc:482] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:40.195850 13086 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:40.196969 13086 raft_consensus.cc:504] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57de620ef1548468cdf7ec700eae99c" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35961 } }
I20260808 05:55:40.197312 13086 leader_election.cc:302] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d57de620ef1548468cdf7ec700eae99c; no voters:
I20260808 05:55:40.197623 13086 leader_election.cc:288] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:40.197722 13095 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:40.197999 13095 raft_consensus.cc:686] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [term 1 LEADER]: Becoming Leader. State: Replica: d57de620ef1548468cdf7ec700eae99c, State: Running, Role: LEADER
I20260808 05:55:40.198432 13095 consensus_queue.cc:237] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57de620ef1548468cdf7ec700eae99c" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35961 } }
I20260808 05:55:40.198936 13086 sys_catalog.cc:564] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:40.200253 13098 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d57de620ef1548468cdf7ec700eae99c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57de620ef1548468cdf7ec700eae99c" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35961 } } }
I20260808 05:55:40.200378 13098 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:40.200790 13097 sys_catalog.cc:455] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [sys.catalog]: SysCatalogTable state changed. Reason: New leader d57de620ef1548468cdf7ec700eae99c. Latest consensus state: current_term: 1 leader_uuid: "d57de620ef1548468cdf7ec700eae99c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d57de620ef1548468cdf7ec700eae99c" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35961 } } }
I20260808 05:55:40.200912 13097 sys_catalog.cc:458] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c [sys.catalog]: This master's current role is: LEADER
W20260808 05:55:40.203842 13113 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:55:40.203923 13113 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:55:40.204001 13106 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:40.204718 13106 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:40.210676 13106 catalog_manager.cc:1347] Generated new cluster ID: 12d2537c2c434f8d8a0eaf2dd0ef66c9
I20260808 05:55:40.210757 13106 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:40.224098 13106 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:40.225471 13106 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:40.232195 13106 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d57de620ef1548468cdf7ec700eae99c: Generated new TSK 0
I20260808 05:55:40.233114 13106 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:55:40.243538 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:35961
--builtin_ntp_servers=127.2.191.84:33493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 05:55:40.359709 13117 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:40.359992 13117 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:40.360030 13117 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:40.364187 13117 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:40.364253 13117 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:40.364307 13117 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:40.369038 13117 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:35961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13117
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:40.370179 13117 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:40.371534 13117 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:40.381647 13124 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:40.381640 13126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:40.381640 13123 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:40.381992 13117 server_base.cc:1034] running on GCE node
I20260808 05:55:40.382464 13117 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:40.383149 13117 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:40.384315 13117 hybrid_clock.cc:648] HybridClock initialized: now 1786168540384293 us; error 32 us; skew 500 ppm
I20260808 05:55:40.386224 13117 webserver.cc:460] Webserver started at http://127.2.191.65:34441/ using document root <none> and password file <none>
I20260808 05:55:40.386827 13117 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:40.386894 13117 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:40.387152 13117 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:40.389309 13117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "fdde150b6b844097887eeccc4967a3dd"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "45e76fb31fb45e839c43e26d091f8041"
server_key_iv: "3cc03ea30160d035500e229753158ad5"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.389884 13117 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "fdde150b6b844097887eeccc4967a3dd"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "45e76fb31fb45e839c43e26d091f8041"
server_key_iv: "3cc03ea30160d035500e229753158ad5"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.393637 13117 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:55:40.396144 13132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.397356 13117 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:40.397482 13117 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "fdde150b6b844097887eeccc4967a3dd"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "45e76fb31fb45e839c43e26d091f8041"
server_key_iv: "3cc03ea30160d035500e229753158ad5"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.397596 13117 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:40.414819 13117 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:40.415566 13117 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:40.415787 13117 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:40.416415 13117 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:40.417464 13117 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:40.417514 13117 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.417580 13117 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:40.417621 13117 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.426612 13117 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:45537
I20260808 05:55:40.426643 13257 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:45537 every 8 connection(s)
I20260808 05:55:40.427554 13117 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:40.430917 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 13117
I20260808 05:55:40.431038 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:40.431401 2813 external_mini_cluster.cc:1428] Setting key 6fcd4599359e74a9b669c8472335aa6b
I20260808 05:55:40.433640 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:35961
--builtin_ntp_servers=127.2.191.84:33493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 05:55:40.438066 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:40.429374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:39385 (local address 127.2.191.126:35961)
0808 05:55:40.429515 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:40.429518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:40.430527 (+ 1009us) server_negotiation.cc:407] Connection header received
0808 05:55:40.432423 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:40.432426 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:40.432473 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:40.432564 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:40.433791 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.434346 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.435937 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.436164 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.436278 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:40.437422 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:40.437425 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:40.437428 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:40.437449 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:40.437467 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:40.437476 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:40.437552 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:40.437766 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 05:55:40.437846 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:55:40.438805 13260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:40.429737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:35961 (local address 127.2.191.65:39385)
0808 05:55:40.430393 (+ 656us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:40.430433 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:40.432186 (+ 1753us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:40.432777 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:40.432787 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:40.432897 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:40.433595 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:40.433616 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.434486 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.434492 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:40.435805 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:40.435815 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.436320 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.436324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:40.436485 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:40.437133 (+ 648us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:40.437136 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:40.437177 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:40.437241 (+ 64us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:40.437566 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:40.437575 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:40.437581 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:55:40.437728 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 05:55:40.437968 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"thread_start_us":119,"threads_started":1}
I20260808 05:55:40.440050 13258 heartbeater.cc:347] Connected to a master server at 127.2.191.126:35961
I20260808 05:55:40.440290 13258 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:40.440917 13258 heartbeater.cc:511] Master 127.2.191.126:35961 requested a full tablet report, sending...
I20260808 05:55:40.442431 13045 ts_manager.cc:194] Registered new tserver with Master: fdde150b6b844097887eeccc4967a3dd (127.2.191.65:45537)
I20260808 05:55:40.443536 13045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.65:39385
W20260808 05:55:40.549185 13261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:40.549479 13261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:40.549548 13261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:40.553754 13261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:40.553828 13261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:40.553886 13261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:40.558884 13261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:35961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:40.560084 13261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:40.561575 13261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:55:40.571609 13261 server_base.cc:1034] running on GCE node
W20260808 05:55:40.571519 13267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:40.571496 13266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:40.571488 13269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:40.572178 13261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:40.572922 13261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:40.574111 13261 hybrid_clock.cc:648] HybridClock initialized: now 1786168540574085 us; error 28 us; skew 500 ppm
I20260808 05:55:40.576016 13261 webserver.cc:460] Webserver started at http://127.2.191.66:43783/ using document root <none> and password file <none>
I20260808 05:55:40.576625 13261 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:40.576750 13261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:40.576984 13261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:40.579670 13261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "9029ef5ac986466fb1f7b567982814b8"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "4fc89c5c4aa64aba1f1cdda84aac1e2a"
server_key_iv: "d0bec579bfc31edeeff1653d13246254"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.580283 13261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "9029ef5ac986466fb1f7b567982814b8"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "4fc89c5c4aa64aba1f1cdda84aac1e2a"
server_key_iv: "d0bec579bfc31edeeff1653d13246254"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.584064 13261 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.002s
I20260808 05:55:40.586761 13276 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.588166 13261 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 05:55:40.588303 13261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "9029ef5ac986466fb1f7b567982814b8"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "4fc89c5c4aa64aba1f1cdda84aac1e2a"
server_key_iv: "d0bec579bfc31edeeff1653d13246254"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.588425 13261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:40.604432 13261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:40.605290 13261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:40.605501 13261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:40.606134 13261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:40.607111 13261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:40.607195 13261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.607285 13261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:40.607340 13261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.616169 13261 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:39739
I20260808 05:55:40.616190 13401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:39739 every 8 connection(s)
I20260808 05:55:40.617199 13261 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:40.620927 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 13261
I20260808 05:55:40.621050 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:40.621347 2813 external_mini_cluster.cc:1428] Setting key 65e2b676608c60903536f78260863400
I20260808 05:55:40.623572 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:35961
--builtin_ntp_servers=127.2.191.84:33493
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 05:55:40.627907 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:40.619153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:54813 (local address 127.2.191.126:35961)
0808 05:55:40.619297 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:40.619301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:40.620630 (+ 1329us) server_negotiation.cc:407] Connection header received
0808 05:55:40.622431 (+ 1801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:40.622434 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:40.622484 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:40.622548 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:40.623607 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.624203 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.625573 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.625814 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.625902 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:40.627249 (+ 1347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:40.627255 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:40.627262 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:40.627281 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:40.627308 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:40.627321 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:40.627405 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:40.627602 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 05:55:40.627681 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:55:40.628876 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:40.619610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:35961 (local address 127.2.191.66:54813)
0808 05:55:40.620469 (+ 859us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:40.620513 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:40.622175 (+ 1662us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:40.622754 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:40.622765 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:40.622879 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:40.623454 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:40.623468 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.624334 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.624338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:40.625437 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:40.625452 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.625978 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.625982 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:40.626209 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:40.626965 (+ 756us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:40.626967 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:40.627012 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:40.627082 (+ 70us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:40.627437 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:40.627446 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:40.627451 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:55:40.627570 (+ 119us) client_negotiation.cc:240] Negotiation successful
0808 05:55:40.627824 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"thread_start_us":173,"threads_started":1}
I20260808 05:55:40.630113 13403 heartbeater.cc:347] Connected to a master server at 127.2.191.126:35961
I20260808 05:55:40.630349 13403 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:40.630892 13403 heartbeater.cc:511] Master 127.2.191.126:35961 requested a full tablet report, sending...
I20260808 05:55:40.631953 13045 ts_manager.cc:194] Registered new tserver with Master: 9029ef5ac986466fb1f7b567982814b8 (127.2.191.66:39739)
I20260808 05:55:40.632540 13045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.66:54813
W20260808 05:55:40.739573 13406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:40.739838 13406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:40.739902 13406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:40.745612 13406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:40.745726 13406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:40.745822 13406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:40.751886 13406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33493
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:35961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:40.753198 13406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:40.754628 13406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:40.764834 13412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:40.764843 13411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:40.764843 13414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:40.765028 13406 server_base.cc:1034] running on GCE node
I20260808 05:55:40.765565 13406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:40.766251 13406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:40.767445 13406 hybrid_clock.cc:648] HybridClock initialized: now 1786168540767431 us; error 25 us; skew 500 ppm
I20260808 05:55:40.769526 13406 webserver.cc:460] Webserver started at http://127.2.191.67:40383/ using document root <none> and password file <none>
I20260808 05:55:40.770171 13406 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:40.770275 13406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:40.770529 13406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:40.772856 13406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "25bc07d832894c938066b60a61ba3bc6"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "6734148b731a5a22a1eb1bf6d447d903"
server_key_iv: "dbee32e42ff4a70a78126b930f7737ff"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.773507 13406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "25bc07d832894c938066b60a61ba3bc6"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "6734148b731a5a22a1eb1bf6d447d903"
server_key_iv: "dbee32e42ff4a70a78126b930f7737ff"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.777627 13406 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:55:40.780404 13420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.781811 13406 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:40.781971 13406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "25bc07d832894c938066b60a61ba3bc6"
format_stamp: "Formatted at 2026-08-08 05:55:40 on dist-test-slave-qg60"
server_key: "6734148b731a5a22a1eb1bf6d447d903"
server_key_iv: "dbee32e42ff4a70a78126b930f7737ff"
server_key_version: "encryptionkey@0"
I20260808 05:55:40.782106 13406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:40.798144 13406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:40.799001 13406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:40.799223 13406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:40.799937 13406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:40.801088 13406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:40.801188 13406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.801254 13406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:40.801307 13406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:40.810189 13406 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:36229
I20260808 05:55:40.810243 13546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:36229 every 8 connection(s)
I20260808 05:55:40.811214 13406 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:40.811472 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 13406
I20260808 05:55:40.811580 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:40.811904 2813 external_mini_cluster.cc:1428] Setting key 4d1e3ea1593070088bc131dcfe6df329
I20260808 05:55:40.821345 13092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:40.813354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:51203 (local address 127.2.191.126:35961)
0808 05:55:40.813496 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:40.813501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:40.814943 (+ 1442us) server_negotiation.cc:407] Connection header received
0808 05:55:40.816300 (+ 1357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:40.816302 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:40.816349 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:40.816419 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:40.817396 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.817920 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.819047 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.819281 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.819362 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:40.820811 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:40.820817 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:40.820822 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:40.820840 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:40.820863 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:40.820872 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:40.820964 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:40.821170 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 05:55:40.821225 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 05:55:40.822324 13549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:40.813938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:35961 (local address 127.2.191.67:51203)
0808 05:55:40.814799 (+ 861us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:40.814844 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:40.816113 (+ 1269us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:40.816572 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:40.816579 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:40.816683 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:40.817264 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:40.817278 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.818032 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.818035 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:40.818930 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:40.818939 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:40.819425 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:40.819428 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:40.819567 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:40.820417 (+ 850us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:40.820421 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:40.820484 (+ 63us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:40.820590 (+ 106us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:40.820998 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:40.821008 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:40.821013 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:55:40.821134 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 05:55:40.821372 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":365,"thread_start_us":178,"threads_started":1}
I20260808 05:55:40.823717 13547 heartbeater.cc:347] Connected to a master server at 127.2.191.126:35961
I20260808 05:55:40.823987 13547 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:40.824544 13547 heartbeater.cc:511] Master 127.2.191.126:35961 requested a full tablet report, sending...
I20260808 05:55:40.825825 13045 ts_manager.cc:194] Registered new tserver with Master: 25bc07d832894c938066b60a61ba3bc6 (127.2.191.67:36229)
I20260808 05:55:40.826678 13045 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.67:51203
I20260808 05:55:40.826728 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:55:40.830013 13092 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:40.828968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37038 (local address 127.2.191.126:35961)
0808 05:55:40.829122 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:40.829128 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:40.829327 (+ 199us) server_negotiation.cc:407] Connection header received
0808 05:55:40.829492 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:40.829495 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:40.829538 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:40.829631 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:40.829897 (+ 266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37038: BlockingRecv error: recv got EOF from 127.0.0.1:37038 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:55:40.830250 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 13117
I20260808 05:55:40.842156 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 13261
I20260808 05:55:40.850449 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 13406
I20260808 05:55:40.858007 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 13009
2026-08-08T05:55:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (895 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T05:55:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:40Z Disabled control of system clock
I20260808 05:55:40.894078 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33673
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:33673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:55:41.010496 13558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:41.010789 13558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:41.010828 13558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:41.014974 13558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:41.015048 13558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:41.015064 13558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:41.015081 13558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:41.015097 13558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:41.020059 13558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:33673
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:41.021373 13558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:41.022827 13558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:41.032009 13567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:41.032014 13565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:41.032056 13558 server_base.cc:1034] running on GCE node
W20260808 05:55:41.032014 13564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:41.032963 13558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:41.034216 13558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:41.035391 13558 hybrid_clock.cc:648] HybridClock initialized: now 1786168541035373 us; error 33 us; skew 500 ppm
I20260808 05:55:41.037506 13558 webserver.cc:460] Webserver started at http://127.2.191.126:36923/ using document root <none> and password file <none>
I20260808 05:55:41.038079 13558 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:41.038153 13558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:41.038332 13558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:41.040431 13558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "f6837bf5d562467eafc4c533684957e9"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "8746a225ff073e6778d880062445c06c"
server_key_iv: "851112bd8816e7da3a21828143aedbd8"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.041059 13558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "f6837bf5d562467eafc4c533684957e9"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "8746a225ff073e6778d880062445c06c"
server_key_iv: "851112bd8816e7da3a21828143aedbd8"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.045042 13558 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:55:41.047775 13573 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.049417 13558 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:41.049562 13558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "f6837bf5d562467eafc4c533684957e9"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "8746a225ff073e6778d880062445c06c"
server_key_iv: "851112bd8816e7da3a21828143aedbd8"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.049692 13558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:41.054646 13558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:41.055433 13558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:41.055642 13558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:41.063051 13558 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:33673
I20260808 05:55:41.063115 13628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:33673 every 8 connection(s)
I20260808 05:55:41.064146 13558 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:41.067382 13629 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:41.070170 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 13558
I20260808 05:55:41.070307 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:41.070605 2813 external_mini_cluster.cc:1428] Setting key ad6c880fd52d144d52f2aa2c0e6fea46
I20260808 05:55:41.073659 13629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9: Bootstrap starting.
I20260808 05:55:41.076306 13629 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:41.076583 13632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:41.072106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34024 (local address 127.2.191.126:33673)
0808 05:55:41.072800 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:41.072818 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:41.072856 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:55:41.073502 (+ 646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:41.073522 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:41.073932 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:41.074232 (+ 300us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:41.075142 (+ 910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:41.075147 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:41.075159 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:41.075169 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:41.075225 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:41.075241 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:41.075364 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:41.075459 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 05:55:41.075737 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":276,"thread_start_us":140,"threads_started":1}
I20260808 05:55:41.077198 13629 log.cc:824] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:41.079232 13629 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9: No bootstrap required, opened a new log
I20260808 05:55:41.083122 13629 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6837bf5d562467eafc4c533684957e9" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33673 } }
I20260808 05:55:41.083374 13629 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:41.083453 13629 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6837bf5d562467eafc4c533684957e9, State: Initialized, Role: FOLLOWER
I20260808 05:55:41.083897 13629 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6837bf5d562467eafc4c533684957e9" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33673 } }
I20260808 05:55:41.084049 13629 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:41.084139 13629 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:41.084263 13629 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:41.085318 13629 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6837bf5d562467eafc4c533684957e9" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33673 } }
I20260808 05:55:41.085672 13629 leader_election.cc:302] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6837bf5d562467eafc4c533684957e9; no voters:
I20260808 05:55:41.086000 13629 leader_election.cc:288] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:41.086171 13634 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:41.086442 13634 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [term 1 LEADER]: Becoming Leader. State: Replica: f6837bf5d562467eafc4c533684957e9, State: Running, Role: LEADER
I20260808 05:55:41.086789 13634 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6837bf5d562467eafc4c533684957e9" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33673 } }
I20260808 05:55:41.087296 13629 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:41.088483 13635 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6837bf5d562467eafc4c533684957e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6837bf5d562467eafc4c533684957e9" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33673 } } }
I20260808 05:55:41.088557 13636 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6837bf5d562467eafc4c533684957e9. Latest consensus state: current_term: 1 leader_uuid: "f6837bf5d562467eafc4c533684957e9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6837bf5d562467eafc4c533684957e9" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33673 } } }
I20260808 05:55:41.088811 13636 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:41.088687 13635 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9 [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:41.089334 13643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:41.092653 13643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:41.098774 13643 catalog_manager.cc:1347] Generated new cluster ID: 65188f8e8dd14416b41250bf44898117
I20260808 05:55:41.098867 13643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:41.110659 13643 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:41.111043 13643 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:41.121097 13643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6837bf5d562467eafc4c533684957e9: Generated new TSK 0
I20260808 05:55:41.121999 13643 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:55:41.132452 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33673
--builtin_ntp_servers=127.2.191.84:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:55:41.248946 13655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:41.249264 13655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:41.249348 13655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:41.253854 13655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:41.253930 13655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:41.254027 13655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:41.259063 13655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13655
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:41.260226 13655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:41.261688 13655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:41.271829 13660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:41.271848 13663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:41.271847 13661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:41.272362 13655 server_base.cc:1034] running on GCE node
I20260808 05:55:41.272895 13655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:41.273561 13655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:41.274760 13655 hybrid_clock.cc:648] HybridClock initialized: now 1786168541274741 us; error 28 us; skew 500 ppm
I20260808 05:55:41.276712 13655 webserver.cc:460] Webserver started at http://127.2.191.65:43487/ using document root <none> and password file <none>
I20260808 05:55:41.277390 13655 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:41.277489 13655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:41.277712 13655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:41.279788 13655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "f54fede055a7493aa2c8926099a485e1"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "a78b935386d20b78e3756c720d0a19fb"
server_key_iv: "23debfb57f593633251c46db09b1f626"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.280373 13655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "f54fede055a7493aa2c8926099a485e1"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "a78b935386d20b78e3756c720d0a19fb"
server_key_iv: "23debfb57f593633251c46db09b1f626"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.284111 13655 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.003s
I20260808 05:55:41.286751 13669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.288110 13655 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 05:55:41.288264 13655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "f54fede055a7493aa2c8926099a485e1"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "a78b935386d20b78e3756c720d0a19fb"
server_key_iv: "23debfb57f593633251c46db09b1f626"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.288395 13655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:41.293278 13655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:41.293916 13655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:41.294117 13655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:41.294673 13655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:41.295626 13655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:41.295701 13655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.295771 13655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:41.295822 13655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.304955 13655 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:43427
I20260808 05:55:41.304988 13793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:43427 every 8 connection(s)
I20260808 05:55:41.305910 13655 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:41.310005 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 13655
I20260808 05:55:41.310154 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:41.310516 2813 external_mini_cluster.cc:1428] Setting key 8da1b979acf82152c95f4658272033d1
I20260808 05:55:41.312692 13632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:41.307822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:34061 (local address 127.2.191.126:33673)
0808 05:55:41.307962 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:41.307966 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:41.309075 (+ 1109us) server_negotiation.cc:407] Connection header received
0808 05:55:41.310752 (+ 1677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:41.310755 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:41.310796 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:41.310876 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:41.312218 (+ 1342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:41.312222 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:41.312225 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:41.312241 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:41.312269 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:41.312283 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:41.312359 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:41.312543 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 05:55:41.312583 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:55:41.313035 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33673
--builtin_ntp_servers=127.2.191.84:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 05:55:41.314000 13796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:41.308193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33673 (local address 127.2.191.65:34061)
0808 05:55:41.308913 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:41.308967 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:41.310495 (+ 1528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:41.311077 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:41.311090 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:41.311216 (+ 126us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:41.311852 (+ 636us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:41.311854 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:41.311916 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:41.312015 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:41.312372 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:41.312382 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:41.312388 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:55:41.312575 (+ 187us) client_negotiation.cc:240] Negotiation successful
0808 05:55:41.312946 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":263,"thread_start_us":110,"threads_started":1}
I20260808 05:55:41.315414 13794 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33673
I20260808 05:55:41.315652 13794 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:41.316068 13794 heartbeater.cc:511] Master 127.2.191.126:33673 requested a full tablet report, sending...
I20260808 05:55:41.317828 13590 ts_manager.cc:194] Registered new tserver with Master: f54fede055a7493aa2c8926099a485e1 (127.2.191.65:43427)
W20260808 05:55:41.430840 13797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:41.431123 13797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:41.431165 13797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:41.435324 13797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:41.435387 13797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:41.435446 13797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:41.440320 13797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:41.441761 13797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:41.443411 13797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:41.453855 13802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:41.453889 13803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:41.453907 13805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:41.454254 13797 server_base.cc:1034] running on GCE node
I20260808 05:55:41.454838 13797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:41.455487 13797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:41.456669 13797 hybrid_clock.cc:648] HybridClock initialized: now 1786168541456633 us; error 52 us; skew 500 ppm
I20260808 05:55:41.458552 13797 webserver.cc:460] Webserver started at http://127.2.191.66:41891/ using document root <none> and password file <none>
I20260808 05:55:41.459170 13797 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:41.459267 13797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:41.459506 13797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:41.461727 13797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "834a927ec8cc4f109604dcc1af7e0c4b"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "c3be9dd5e7057426188b2910974460ef"
server_key_iv: "1d4e3baf28a324338daab87397a9ab70"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.462287 13797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "834a927ec8cc4f109604dcc1af7e0c4b"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "c3be9dd5e7057426188b2910974460ef"
server_key_iv: "1d4e3baf28a324338daab87397a9ab70"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.466058 13797 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.004s sys 0.001s
I20260808 05:55:41.468665 13813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.470017 13797 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:41.470197 13797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "834a927ec8cc4f109604dcc1af7e0c4b"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "c3be9dd5e7057426188b2910974460ef"
server_key_iv: "1d4e3baf28a324338daab87397a9ab70"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.470328 13797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:41.475104 13797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:41.475754 13797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:41.475944 13797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:41.476513 13797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:41.477533 13797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:41.477608 13797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.477679 13797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:41.477731 13797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.487182 13797 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:36025
I20260808 05:55:41.487207 13935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:36025 every 8 connection(s)
I20260808 05:55:41.488232 13797 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:41.490988 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 13797
I20260808 05:55:41.491163 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:41.491545 2813 external_mini_cluster.cc:1428] Setting key e994b7ffcd2f5e0c32a1033abd6e4ac5
I20260808 05:55:41.493814 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33673
--builtin_ntp_servers=127.2.191.84:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 05:55:41.495491 13632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:41.490297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:51969 (local address 127.2.191.126:33673)
0808 05:55:41.490475 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:41.490480 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:41.491703 (+ 1223us) server_negotiation.cc:407] Connection header received
0808 05:55:41.493398 (+ 1695us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:41.493401 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:41.493443 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:41.493536 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:41.494936 (+ 1400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:41.494940 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:41.494943 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:41.494957 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:41.494984 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:41.494996 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:41.495105 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:41.495230 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 05:55:41.495279 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 05:55:41.496438 13939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:41.490747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33673 (local address 127.2.191.66:51969)
0808 05:55:41.491538 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:41.491596 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:41.493183 (+ 1587us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:41.493694 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:41.493700 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:41.493796 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:41.494657 (+ 861us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:41.494659 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:41.494701 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:41.494770 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:41.495098 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:41.495105 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:41.495111 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:55:41.495248 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 05:55:41.495444 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":153,"threads_started":1}
I20260808 05:55:41.497681 13937 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33673
I20260808 05:55:41.497943 13937 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:41.498435 13937 heartbeater.cc:511] Master 127.2.191.126:33673 requested a full tablet report, sending...
I20260808 05:55:41.499665 13590 ts_manager.cc:194] Registered new tserver with Master: 834a927ec8cc4f109604dcc1af7e0c4b (127.2.191.66:36025)
W20260808 05:55:41.612360 13940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:41.612691 13940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:41.612794 13940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:41.617034 13940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:41.617161 13940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:41.617268 13940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:41.622419 13940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33673
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:41.623621 13940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:41.625201 13940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:41.635519 13945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:41.635730 13940 server_base.cc:1034] running on GCE node
W20260808 05:55:41.635525 13948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:41.635574 13946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:41.636296 13940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:41.637029 13940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:41.638222 13940 hybrid_clock.cc:648] HybridClock initialized: now 1786168541638205 us; error 29 us; skew 500 ppm
I20260808 05:55:41.640324 13940 webserver.cc:460] Webserver started at http://127.2.191.67:38385/ using document root <none> and password file <none>
I20260808 05:55:41.641013 13940 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:41.641086 13940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:41.641317 13940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:41.643491 13940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "0589b7dbd4194fb1ac035fec56af1adb"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "acd90afda1b227f8001c82a291663aa9"
server_key_iv: "ee9598c915e1c17687570fa5cd0bbac3"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.644110 13940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "0589b7dbd4194fb1ac035fec56af1adb"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "acd90afda1b227f8001c82a291663aa9"
server_key_iv: "ee9598c915e1c17687570fa5cd0bbac3"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.648082 13940 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.004s
I20260808 05:55:41.651051 13954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.652434 13940 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 05:55:41.652611 13940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "0589b7dbd4194fb1ac035fec56af1adb"
format_stamp: "Formatted at 2026-08-08 05:55:41 on dist-test-slave-qg60"
server_key: "acd90afda1b227f8001c82a291663aa9"
server_key_iv: "ee9598c915e1c17687570fa5cd0bbac3"
server_key_version: "encryptionkey@0"
I20260808 05:55:41.652778 13940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:41.657527 13940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:41.658167 13940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:41.658358 13940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:41.658958 13940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:41.659905 13940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:41.659992 13940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.660068 13940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:41.660146 13940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:41.669260 13940 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:37009
I20260808 05:55:41.669283 14083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:37009 every 8 connection(s)
I20260808 05:55:41.670213 13940 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:41.671926 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 13940
I20260808 05:55:41.672040 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:41.672370 2813 external_mini_cluster.cc:1428] Setting key 86f320d78b980dd22a36a888bb4c1083
I20260808 05:55:41.677343 13632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:41.672231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:42953 (local address 127.2.191.126:33673)
0808 05:55:41.672383 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:41.672387 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:41.673848 (+ 1461us) server_negotiation.cc:407] Connection header received
0808 05:55:41.675481 (+ 1633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:41.675484 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:41.675530 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:41.675623 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:41.676836 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:41.676840 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:41.676843 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:55:41.676856 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:41.676881 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:55:41.676898 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:41.676995 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:41.677154 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 05:55:41.677202 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:55:41.678226 14086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:41.672771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33673 (local address 127.2.191.67:42953)
0808 05:55:41.673695 (+ 924us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:41.673756 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:41.675266 (+ 1510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:41.675794 (+ 528us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:41.675801 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:41.675890 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:41.676528 (+ 638us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:55:41.676530 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:41.676574 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:55:41.676647 (+ 73us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:41.676994 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:41.677005 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:41.677013 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 05:55:41.677202 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 05:55:41.677454 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":383,"thread_start_us":145,"threads_started":1}
I20260808 05:55:41.679325 14084 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33673
I20260808 05:55:41.679538 14084 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:41.679913 14084 heartbeater.cc:511] Master 127.2.191.126:33673 requested a full tablet report, sending...
I20260808 05:55:41.680932 13590 ts_manager.cc:194] Registered new tserver with Master: 0589b7dbd4194fb1ac035fec56af1adb (127.2.191.67:37009)
I20260808 05:55:41.686905 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:55:41.690361 13632 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:55:41.689237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34028 (local address 127.2.191.126:33673)
0808 05:55:41.689404 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:41.689410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:41.689587 (+ 177us) server_negotiation.cc:407] Connection header received
0808 05:55:41.689798 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:41.689806 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:41.689842 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:41.689930 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:41.690215 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34028: BlockingRecv error: recv got EOF from 127.0.0.1:34028 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:55:41.690851 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 13655
I20260808 05:55:41.702347 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 13797
I20260808 05:55:41.711061 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 13940
I20260808 05:55:41.720475 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 13558
2026-08-08T05:55:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (859 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:55:41 dist-test-slave-qg60 krb5kdc[14095](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:55:41 dist-test-slave-qg60 krb5kdc[14095](info): set up 2 sockets
Aug 08 05:55:41 dist-test-slave-qg60 krb5kdc[14095](info): commencing operation
krb5kdc: starting...
W20260808 05:55:42.819290 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:42 dist-test-slave-qg60 krb5kdc[14095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:55:42.956367 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:46491
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:46491
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:43.084677 14109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:43.085191 14109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:43.085314 14109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:43.089872 14109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:55:43.089970 14109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:43.090014 14109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:43.090076 14109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:55:43.090117 14109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:55:43.096225 14109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:46491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:46491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:43.097424 14109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:43.098519 14109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:43.107681 14119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:43.107693 14117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:43.107846 14109 server_base.cc:1034] running on GCE node
W20260808 05:55:43.107694 14116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:43.108716 14109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:43.109997 14109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:43.111200 14109 hybrid_clock.cc:648] HybridClock initialized: now 1786168543111185 us; error 30 us; skew 500 ppm
Aug 08 05:55:43 dist-test-slave-qg60 krb5kdc[14095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168543, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:43.114245 14109 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:55:43.115193 14109 webserver.cc:460] Webserver started at http://127.2.191.126:40869/ using document root <none> and password file <none>
I20260808 05:55:43.115777 14109 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:43.115872 14109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:43.116118 14109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:43.118257 14109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "366b2424331d4bc1892ac654eba00f5e"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "fb9e8e7d4185f19f61d3cdf2626b7be3"
server_key_iv: "cabef14360a99021028419ad65b15953"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.118846 14109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "366b2424331d4bc1892ac654eba00f5e"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "fb9e8e7d4185f19f61d3cdf2626b7be3"
server_key_iv: "cabef14360a99021028419ad65b15953"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.122725 14109 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:55:43.125211 14127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.126453 14109 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:55:43.126601 14109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "366b2424331d4bc1892ac654eba00f5e"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "fb9e8e7d4185f19f61d3cdf2626b7be3"
server_key_iv: "cabef14360a99021028419ad65b15953"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.126717 14109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:43.139837 14109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:43.143272 14109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:43.143486 14109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:43.150719 14109 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:46491
I20260808 05:55:43.151016 14184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:46491 every 8 connection(s)
I20260808 05:55:43.151736 14109 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:55:43.153620 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 14109
I20260808 05:55:43.153751 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:55:43.154078 2813 external_mini_cluster.cc:1428] Setting key d1b4a4576bafdbb54bf9e7d8484151c9
I20260808 05:55:43.155022 14185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:43.161914 14185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e: Bootstrap starting.
Aug 08 05:55:43 dist-test-slave-qg60 krb5kdc[14095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:43.164856 14185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:43.165649 14185 log.cc:824] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:43.168078 14185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e: No bootstrap required, opened a new log
I20260808 05:55:43.169636 14188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.155489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56240 (local address 127.2.191.126:46491)
0808 05:55:43.155911 (+ 422us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:43.155930 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:43.155973 (+ 43us) server_negotiation.cc:407] Connection header received
0808 05:55:43.156865 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:43.156887 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:43.157309 (+ 422us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:43.157678 (+ 369us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:43.158360 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.159815 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.160661 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.161386 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.161550 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.164389 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:43.164396 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:43.164412 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:43.164446 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:43.166441 (+ 1995us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.166958 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.166962 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.166967 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.167083 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.167421 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.167424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.167425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.167903 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:43.168123 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:43.168434 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 05:55:43.168793 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":126,"threads_started":1}
I20260808 05:55:43.171911 14185 raft_consensus.cc:348] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366b2424331d4bc1892ac654eba00f5e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46491 } }
I20260808 05:55:43.172192 14185 raft_consensus.cc:374] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:43.172271 14185 raft_consensus.cc:729] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 366b2424331d4bc1892ac654eba00f5e, State: Initialized, Role: FOLLOWER
I20260808 05:55:43.172703 14185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366b2424331d4bc1892ac654eba00f5e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46491 } }
I20260808 05:55:43.172917 14185 raft_consensus.cc:388] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:55:43.173009 14185 raft_consensus.cc:482] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:55:43.173110 14185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:43.174129 14185 raft_consensus.cc:504] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366b2424331d4bc1892ac654eba00f5e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46491 } }
I20260808 05:55:43.174474 14185 leader_election.cc:302] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 366b2424331d4bc1892ac654eba00f5e; no voters:
I20260808 05:55:43.174820 14185 leader_election.cc:288] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:55:43.174939 14192 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:43.175179 14192 raft_consensus.cc:686] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [term 1 LEADER]: Becoming Leader. State: Replica: 366b2424331d4bc1892ac654eba00f5e, State: Running, Role: LEADER
I20260808 05:55:43.175567 14192 consensus_queue.cc:237] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366b2424331d4bc1892ac654eba00f5e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46491 } }
I20260808 05:55:43.176079 14185 sys_catalog.cc:564] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:55:43.177428 14194 sys_catalog.cc:455] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 366b2424331d4bc1892ac654eba00f5e. Latest consensus state: current_term: 1 leader_uuid: "366b2424331d4bc1892ac654eba00f5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366b2424331d4bc1892ac654eba00f5e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46491 } } }
I20260808 05:55:43.177443 14193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "366b2424331d4bc1892ac654eba00f5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "366b2424331d4bc1892ac654eba00f5e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46491 } } }
I20260808 05:55:43.177592 14193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [sys.catalog]: This master's current role is: LEADER
I20260808 05:55:43.177590 14194 sys_catalog.cc:458] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e [sys.catalog]: This master's current role is: LEADER
W20260808 05:55:43.181238 14208 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:55:43.181350 14208 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:55:43.181430 14202 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:55:43.182152 14202 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:55:43.187918 14202 catalog_manager.cc:1347] Generated new cluster ID: ae48192e11be421ea73855d72936f62d
I20260808 05:55:43.187988 14202 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:55:43.202950 14202 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:55:43.203951 14202 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:55:43.215857 14202 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e: Generated new TSK 0
I20260808 05:55:43.216625 14202 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:55:43.253279 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:46491
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:43.374497 14215 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:43.374805 14215 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:43.374884 14215 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:43.379328 14215 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:43.379415 14215 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:43.379508 14215 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:55:43.384838 14215 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:46491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14215
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:43.385974 14215 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:43.387024 14215 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:43.397354 14225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:43.397373 14222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:43.397433 14215 server_base.cc:1034] running on GCE node
W20260808 05:55:43.397397 14223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:43.398068 14215 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:43.398808 14215 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:43.400003 14215 hybrid_clock.cc:648] HybridClock initialized: now 1786168543399985 us; error 30 us; skew 500 ppm
Aug 08 05:55:43 dist-test-slave-qg60 krb5kdc[14095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168543, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:43.403074 14215 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:55:43.403981 14215 webserver.cc:460] Webserver started at http://127.2.191.65:37585/ using document root <none> and password file <none>
I20260808 05:55:43.404569 14215 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:43.404670 14215 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:43.404937 14215 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:43.407055 14215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "d032c8e3cd3f4259837db79f2e9a42ca"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "7d4f2c1732ab6aec13611a6f001ec8bb"
server_key_iv: "968a79f6c0c95081df83f02af4fedf9e"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.407663 14215 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "d032c8e3cd3f4259837db79f2e9a42ca"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "7d4f2c1732ab6aec13611a6f001ec8bb"
server_key_iv: "968a79f6c0c95081df83f02af4fedf9e"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.411546 14215 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:55:43.414029 14232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.415283 14215 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:55:43.415426 14215 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "d032c8e3cd3f4259837db79f2e9a42ca"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "7d4f2c1732ab6aec13611a6f001ec8bb"
server_key_iv: "968a79f6c0c95081df83f02af4fedf9e"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.415544 14215 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:43.431412 14215 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:43.435029 14215 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:43.435281 14215 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:43.435954 14215 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:43.436892 14215 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:43.436970 14215 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.437049 14215 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:43.437094 14215 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.447198 14215 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:43551
I20260808 05:55:43.447217 14357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:43551 every 8 connection(s)
I20260808 05:55:43.448205 14215 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:55:43.451552 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 14215
I20260808 05:55:43.451706 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:55:43.452095 2813 external_mini_cluster.cc:1428] Setting key 5765063d188140c6394b30452a34e291
Aug 08 05:55:43 dist-test-slave-qg60 krb5kdc[14095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168543, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:55:43.464466 14188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.450149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:60199 (local address 127.2.191.126:46491)
0808 05:55:43.450316 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:43.450321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:43.451272 (+ 951us) server_negotiation.cc:407] Connection header received
0808 05:55:43.453178 (+ 1906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:43.453181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:43.453243 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:43.453322 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:43.454977 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.455524 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.456906 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.457334 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.457464 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.460408 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:43.460415 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:43.460421 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:43.460462 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:43.462244 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.462797 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.462803 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.462805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.462912 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.463270 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.463276 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.463280 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.463560 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:43.463673 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:43.464180 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 05:55:43.464299 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 05:55:43.465425 14360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.450638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:46491 (local address 127.2.191.65:60199)
0808 05:55:43.451106 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:43.451154 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:43.452918 (+ 1764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:43.453507 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:43.453515 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:43.454034 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:43.454793 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.454819 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.455669 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.455676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.456722 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.456790 (+ 68us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.457497 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.457500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.457654 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.458311 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:43.458330 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:43.460201 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:43.462382 (+ 2181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:43.462388 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:43.462401 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:43.462677 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:43.463020 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:43.463022 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:43.463024 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:43.463171 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:43.463687 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:43.463692 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:43.463954 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 05:55:43.464136 (+ 182us) client_negotiation.cc:240] Negotiation successful
0808 05:55:43.464483 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":111,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:55:43.467041 14358 heartbeater.cc:347] Connected to a master server at 127.2.191.126:46491
I20260808 05:55:43.467353 14358 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:43.468076 14358 heartbeater.cc:511] Master 127.2.191.126:46491 requested a full tablet report, sending...
I20260808 05:55:43.469990 14147 ts_manager.cc:194] Registered new tserver with Master: d032c8e3cd3f4259837db79f2e9a42ca (127.2.191.65:43551)
I20260808 05:55:43.471292 14147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:60199
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:55:43.484476 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:46491
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:43.598953 14363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:43.599205 14363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:43.599246 14363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:43.603256 14363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:43.603317 14363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:43.603420 14363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:55:43.609350 14363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:46491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:43.610538 14363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:43.611654 14363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:43.621894 14372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:43.621906 14370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:43.621896 14368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:43.622125 14363 server_base.cc:1034] running on GCE node
I20260808 05:55:43.622587 14363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:43.623188 14363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:43.624361 14363 hybrid_clock.cc:648] HybridClock initialized: now 1786168543624343 us; error 28 us; skew 500 ppm
Aug 08 05:55:43 dist-test-slave-qg60 krb5kdc[14095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168543, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:43.632462 14363 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:55:43.633507 14363 webserver.cc:460] Webserver started at http://127.2.191.66:37313/ using document root <none> and password file <none>
I20260808 05:55:43.634155 14363 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:43.634256 14363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:43.634503 14363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:43.636667 14363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "b347255ec0d745dd98e8974af653b599"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "fd96fadaf7f3013d42c2335a85ab10fe"
server_key_iv: "f96981dd1b123e2e088919b775f8ec1f"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.637351 14363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "b347255ec0d745dd98e8974af653b599"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "fd96fadaf7f3013d42c2335a85ab10fe"
server_key_iv: "f96981dd1b123e2e088919b775f8ec1f"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.641595 14363 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 05:55:43.644269 14379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.645805 14363 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:55:43.645967 14363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "b347255ec0d745dd98e8974af653b599"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "fd96fadaf7f3013d42c2335a85ab10fe"
server_key_iv: "f96981dd1b123e2e088919b775f8ec1f"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.646126 14363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:43.672683 14363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:43.676438 14363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:43.676666 14363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:43.677498 14363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:43.678491 14363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:43.678567 14363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.678638 14363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:43.678687 14363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.687873 14363 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:46845
I20260808 05:55:43.687896 14498 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:46845 every 8 connection(s)
I20260808 05:55:43.688989 14363 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:55:43.692574 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 14363
I20260808 05:55:43.692711 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:55:43.693022 2813 external_mini_cluster.cc:1428] Setting key d7bcd0f0ddd92b1768e81970af813ad4
Aug 08 05:55:43 dist-test-slave-qg60 krb5kdc[14095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168543, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:55:43.704672 14188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.691007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:56685 (local address 127.2.191.126:46491)
0808 05:55:43.691162 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:43.691166 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:43.692126 (+ 960us) server_negotiation.cc:407] Connection header received
0808 05:55:43.693692 (+ 1566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:43.693695 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:43.693744 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:43.693854 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:43.695152 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.695995 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.697246 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.697475 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.697604 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.700611 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:43.700614 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:43.700616 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:43.700642 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:43.702185 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.702834 (+ 649us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.702836 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.702838 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.702916 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.703321 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.703324 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.703325 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.703504 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:43.703578 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:43.704319 (+ 741us) server_negotiation.cc:299] Negotiation successful
0808 05:55:43.704452 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 05:55:43.705571 14501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.691494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:46491 (local address 127.2.191.66:56685)
0808 05:55:43.691968 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:43.692014 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:43.693451 (+ 1437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:43.694015 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:43.694022 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:43.694496 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:43.695000 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.695015 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.696148 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.696150 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.697117 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.697127 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.697637 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.697642 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.697832 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.698502 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:43.698519 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:43.700412 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:43.702311 (+ 1899us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:43.702319 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:43.702336 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:43.702729 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:43.703013 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:43.703018 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:43.703021 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:43.703218 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:43.703615 (+ 397us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:43.703625 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:43.703990 (+ 365us) client_negotiation.cc:769] Sending connection context
0808 05:55:43.704233 (+ 243us) client_negotiation.cc:240] Negotiation successful
0808 05:55:43.704633 (+ 400us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":127,"threads_started":1}
I20260808 05:55:43.707088 14499 heartbeater.cc:347] Connected to a master server at 127.2.191.126:46491
I20260808 05:55:43.707384 14499 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:55:43.708046 14499 heartbeater.cc:511] Master 127.2.191.126:46491 requested a full tablet report, sending...
I20260808 05:55:43.709278 14147 ts_manager.cc:194] Registered new tserver with Master: b347255ec0d745dd98e8974af653b599 (127.2.191.66:46845)
I20260808 05:55:43.709967 14147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:56685
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:55:43.728014 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:46491
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:55:43.843652 14504 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:55:43.843983 14504 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:55:43.844070 14504 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:55:43.848243 14504 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:55:43.848366 14504 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:55:43.848466 14504 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:55:43.854197 14504 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:46491
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14504
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:55:43.855388 14504 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:55:43.856469 14504 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:55:43.866564 14512 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:55:43.866555 14510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:43.866663 14504 server_base.cc:1034] running on GCE node
W20260808 05:55:43.866564 14509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:55:43.867329 14504 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:55:43.867949 14504 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:55:43.869163 14504 hybrid_clock.cc:648] HybridClock initialized: now 1786168543869142 us; error 32 us; skew 500 ppm
Aug 08 05:55:43 dist-test-slave-qg60 krb5kdc[14095](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168543, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:55:43.872002 14504 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:55:43.872905 14504 webserver.cc:460] Webserver started at http://127.2.191.67:34391/ using document root <none> and password file <none>
I20260808 05:55:43.873478 14504 fs_manager.cc:359] Metadata directory not provided
I20260808 05:55:43.873538 14504 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:55:43.873709 14504 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:55:43.875799 14504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "2a06f7c9cceb446db11f7ecf475553cf"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "817b9d4b6d4dac73fc4a1e7a036de4b9"
server_key_iv: "fbb6b3e68973a2941e2f8a46765acd24"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.876343 14504 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "2a06f7c9cceb446db11f7ecf475553cf"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "817b9d4b6d4dac73fc4a1e7a036de4b9"
server_key_iv: "fbb6b3e68973a2941e2f8a46765acd24"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.880292 14504 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:55:43.882896 14520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.884153 14504 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 05:55:43.884308 14504 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "2a06f7c9cceb446db11f7ecf475553cf"
format_stamp: "Formatted at 2026-08-08 05:55:43 on dist-test-slave-qg60"
server_key: "817b9d4b6d4dac73fc4a1e7a036de4b9"
server_key_iv: "fbb6b3e68973a2941e2f8a46765acd24"
server_key_version: "encryptionkey@0"
I20260808 05:55:43.884436 14504 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:55:43.899415 14504 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:55:43.902554 14504 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:55:43.902773 14504 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:55:43.903388 14504 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:55:43.904251 14504 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:55:43.904325 14504 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.904397 14504 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:55:43.904452 14504 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:55:43.913403 14504 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:46773
I20260808 05:55:43.913424 14645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:46773 every 8 connection(s)
I20260808 05:55:43.914469 14504 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:55:43.915529 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 14504
I20260808 05:55:43.915668 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:55:43.916160 2813 external_mini_cluster.cc:1428] Setting key ab51b76147678659d66034502947ce93
Aug 08 05:55:43 dist-test-slave-qg60 krb5kdc[14095](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168543, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:55:43.930099 14188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.916995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:52467 (local address 127.2.191.126:46491)
0808 05:55:43.917162 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:43.917167 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:43.918115 (+ 948us) server_negotiation.cc:407] Connection header received
0808 05:55:43.919741 (+ 1626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:43.919745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:43.919806 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:43.919883 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:43.921202 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.921757 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.922971 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.923212 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.923331 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.926131 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:43.926134 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:43.926137 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:43.926174 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:43.927685 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.928229 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.928234 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.928236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.928325 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.928721 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.928772 (+ 51us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.928773 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.928993 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:43.929113 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:43.929783 (+ 670us) server_negotiation.cc:299] Negotiation successful
0808 05:55:43.929921 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:55:43.931227 14649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.917457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:46491 (local address 127.2.191.67:52467)
0808 05:55:43.917969 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:43.918018 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:43.919525 (+ 1507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:43.920075 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:43.920083 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:43.920472 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:55:43.921054 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.921069 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.921897 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.921901 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.922800 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.922809 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.923376 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.923380 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.923566 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.924235 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:55:43.924253 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:55:43.925813 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:55:43.927813 (+ 2000us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:43.927819 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:43.927836 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:43.928120 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:43.928421 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:55:43.928425 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:55:43.928427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:55:43.928586 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:55:43.929122 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:55:43.929131 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:55:43.929461 (+ 330us) client_negotiation.cc:769] Sending connection context
0808 05:55:43.929702 (+ 241us) client_negotiation.cc:240] Negotiation successful
0808 05:55:43.930151 (+ 449us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"thread_start_us":139,"threads_started":1}
I20260808 05:55:43.932454 14647 heartbeater.cc:347] Connected to a master server at 127.2.191.126:46491
I20260808 05:55:43.932775 14647 heartbeater.cc:464] Registering TS with master...
I20260808 05:55:43.933322 14647 heartbeater.cc:511] Master 127.2.191.126:46491 requested a full tablet report, sending...
I20260808 05:55:43.934415 14147 ts_manager.cc:194] Registered new tserver with Master: 2a06f7c9cceb446db11f7ecf475553cf (127.2.191.67:46773)
I20260808 05:55:43.934975 14147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:52467
I20260808 05:55:43.942986 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:55:43.952800 14188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.945093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34852 (local address 127.2.191.126:46491)
0808 05:55:43.945400 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:43.945404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:43.945418 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:43.945500 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:43.945502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:43.945544 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:43.945617 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:55:43.946334 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.946844 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.947661 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.947881 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.947963 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.949386 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:55:43.949389 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:55:43.949392 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:55:43.949451 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:55:43.951133 (+ 1682us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.951525 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.951528 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.951529 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.951604 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:55:43.951858 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:55:43.951861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:55:43.951862 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:55:43.952098 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:55:43.952211 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:43.952411 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 05:55:43.952511 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":218}
I20260808 05:55:43.955622 14147 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34852:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:55:43.958881 14147 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:55:43.973871 14660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.967598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:43551 (local address 127.0.0.1:47446)
0808 05:55:43.968858 (+ 1260us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:43.968869 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:43.968997 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:43.969555 (+ 558us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:43.969557 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:43.969591 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:43.969760 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.969771 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.970851 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.970856 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.972083 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.972093 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.973253 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.973257 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.973363 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.973408 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:55:43.973526 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 05:55:43.973674 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1185,"mutex_wait_us":3,"spinlock_wait_cycles":7552,"thread_start_us":116,"threads_started":1}
I20260808 05:55:43.974128 14658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.967533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:46773 (local address 127.0.0.1:51174)
0808 05:55:43.968376 (+ 843us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:43.968431 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:43.968555 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:43.969548 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:43.969554 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:43.969590 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:43.969883 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.969892 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.971724 (+ 1832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.971728 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.972855 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.972863 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.973660 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.973664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.973778 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.973800 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 05:55:43.973905 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 05:55:43.973980 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"mutex_wait_us":130,"spinlock_wait_cycles":6528,"thread_start_us":100,"threads_started":1}
I20260808 05:55:43.974181 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.968027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47446 (local address 127.2.191.65:43551)
0808 05:55:43.968437 (+ 410us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:43.968444 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:43.969137 (+ 693us) server_negotiation.cc:407] Connection header received
0808 05:55:43.969223 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:43.969227 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:43.969434 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:43.969579 (+ 145us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:43.969912 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.970722 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.972216 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.972907 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.973019 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.973186 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:43.973919 (+ 733us) server_negotiation.cc:299] Negotiation successful
0808 05:55:43.974027 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":296,"thread_start_us":91,"threads_started":1}
I20260808 05:55:43.974675 14661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.967692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51174 (local address 127.2.191.67:46773)
0808 05:55:43.968658 (+ 966us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:43.968670 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:43.968695 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:55:43.968802 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:43.968808 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:43.969066 (+ 258us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:43.969244 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:43.970013 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.971552 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.972968 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.973524 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.973660 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.973807 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:43.974369 (+ 562us) server_negotiation.cc:299] Negotiation successful
0808 05:55:43.974500 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":150,"threads_started":1}
I20260808 05:55:43.974965 14663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.968316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:46845 (local address 127.0.0.1:48194)
0808 05:55:43.969193 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:43.969207 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:43.969297 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:43.969759 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:43.969762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:43.969779 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:43.969917 (+ 138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.969922 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.971321 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.971324 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.972563 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:43.972574 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.973920 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.973924 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:43.974631 (+ 707us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.974658 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 05:55:43.974738 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:55:43.974822 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"mutex_wait_us":4,"thread_start_us":90,"threads_started":1}
I20260808 05:55:43.975394 14664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:43.968762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48194 (local address 127.2.191.66:46845)
0808 05:55:43.969124 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:43.969138 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:43.969291 (+ 153us) server_negotiation.cc:407] Connection header received
0808 05:55:43.969395 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:43.969400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:43.969563 (+ 163us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:43.969706 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:43.970073 (+ 367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.971172 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.972703 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:43.973560 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:43.973672 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:43.973832 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:43.975147 (+ 1315us) server_negotiation.cc:299] Negotiation successful
0808 05:55:43.975253 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":122,"threads_started":1}
I20260808 05:55:43.977545 14285 tablet_service.cc:1467] Processing CreateTablet for tablet 3cdff82f44a5421f9f3020e496cb8df3 (DEFAULT_TABLE table=test-table [id=bab8bab738a64dcb977b4696edeeda10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:43.977891 14429 tablet_service.cc:1467] Processing CreateTablet for tablet 3cdff82f44a5421f9f3020e496cb8df3 (DEFAULT_TABLE table=test-table [id=bab8bab738a64dcb977b4696edeeda10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:43.977815 14577 tablet_service.cc:1467] Processing CreateTablet for tablet 3cdff82f44a5421f9f3020e496cb8df3 (DEFAULT_TABLE table=test-table [id=bab8bab738a64dcb977b4696edeeda10]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:55:43.978828 14429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cdff82f44a5421f9f3020e496cb8df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:43.978837 14577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cdff82f44a5421f9f3020e496cb8df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:43.978824 14285 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3cdff82f44a5421f9f3020e496cb8df3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:55:43.987442 14667 tablet_bootstrap.cc:492] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: Bootstrap starting.
I20260808 05:55:43.988880 14668 tablet_bootstrap.cc:492] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: Bootstrap starting.
I20260808 05:55:43.989207 14665 tablet_bootstrap.cc:492] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca: Bootstrap starting.
I20260808 05:55:43.990887 14667 tablet_bootstrap.cc:654] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:43.991245 14665 tablet_bootstrap.cc:654] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:43.991935 14665 log.cc:824] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:43.991909 14667 log.cc:824] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:43.992059 14668 tablet_bootstrap.cc:654] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: Neither blocks nor log segments found. Creating new log.
I20260808 05:55:43.992936 14668 log.cc:824] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: Log is configured to *not* fsync() on all Append() calls
I20260808 05:55:43.994249 14667 tablet_bootstrap.cc:492] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: No bootstrap required, opened a new log
I20260808 05:55:43.994457 14667 ts_tablet_manager.cc:1397] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s
I20260808 05:55:43.994997 14668 tablet_bootstrap.cc:492] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: No bootstrap required, opened a new log
I20260808 05:55:43.995213 14668 ts_tablet_manager.cc:1397] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 05:55:43.998520 14667 raft_consensus.cc:348] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:43.998816 14667 raft_consensus.cc:374] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:43.998888 14667 raft_consensus.cc:729] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b347255ec0d745dd98e8974af653b599, State: Initialized, Role: FOLLOWER
I20260808 05:55:43.999197 14665 tablet_bootstrap.cc:492] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca: No bootstrap required, opened a new log
I20260808 05:55:43.999382 14665 ts_tablet_manager.cc:1397] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260808 05:55:43.999361 14667 consensus_queue.cc:260] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:44.000137 14499 heartbeater.cc:503] Master 127.2.191.126:46491 was elected leader, sending a full tablet report...
I20260808 05:55:44.000447 14667 ts_tablet_manager.cc:1428] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20260808 05:55:44.002825 14668 raft_consensus.cc:348] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:44.003177 14668 raft_consensus.cc:374] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:44.003244 14668 raft_consensus.cc:729] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a06f7c9cceb446db11f7ecf475553cf, State: Initialized, Role: FOLLOWER
I20260808 05:55:44.003803 14668 consensus_queue.cc:260] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:44.004196 14665 raft_consensus.cc:348] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:44.004500 14665 raft_consensus.cc:374] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:55:44.004525 14647 heartbeater.cc:503] Master 127.2.191.126:46491 was elected leader, sending a full tablet report...
I20260808 05:55:44.004573 14665 raft_consensus.cc:729] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d032c8e3cd3f4259837db79f2e9a42ca, State: Initialized, Role: FOLLOWER
I20260808 05:55:44.004953 14668 ts_tablet_manager.cc:1428] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20260808 05:55:44.005260 14665 consensus_queue.cc:260] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:44.006392 14665 ts_tablet_manager.cc:1428] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 05:55:44.006750 14358 heartbeater.cc:503] Master 127.2.191.126:46491 was elected leader, sending a full tablet report...
I20260808 05:55:44.062695 14674 raft_consensus.cc:482] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:55:44.062940 14674 raft_consensus.cc:504] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:44.064106 14674 leader_election.cc:288] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a06f7c9cceb446db11f7ecf475553cf (127.2.191.67:46773), b347255ec0d745dd98e8974af653b599 (127.2.191.66:46845)
I20260808 05:55:44.070050 14664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:44.064549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:52343 (local address 127.2.191.66:46845)
0808 05:55:44.064687 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:44.064692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:44.065019 (+ 327us) server_negotiation.cc:407] Connection header received
0808 05:55:44.065190 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:44.065193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:44.065252 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:44.065350 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:44.065703 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.066531 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.068589 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.069252 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.069388 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:44.069442 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:44.069838 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 05:55:44.069916 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:55:44.070050 14661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:44.064549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:37921 (local address 127.2.191.67:46773)
0808 05:55:44.064687 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:44.064692 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:44.065019 (+ 327us) server_negotiation.cc:407] Connection header received
0808 05:55:44.065190 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:44.065193 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:44.065248 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:44.065348 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:55:44.065799 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.066555 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.068580 (+ 2025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.069261 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.069388 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:44.069442 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:44.069822 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 05:55:44.069911 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 05:55:44.070092 14675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:44.064427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:46773 (local address 127.2.191.65:37921)
0808 05:55:44.064892 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:44.064910 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:44.065064 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:44.065494 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:44.065497 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:44.065513 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:44.065668 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:44.065675 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.066678 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.066682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:44.068432 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:44.068446 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.069393 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.069397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:44.069538 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:44.069675 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 05:55:44.069757 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 05:55:44.069865 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"mutex_wait_us":250,"spinlock_wait_cycles":12288,"thread_start_us":113,"threads_started":1}
I20260808 05:55:44.070092 14676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:44.064427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:46845 (local address 127.2.191.65:52343)
0808 05:55:44.064925 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:44.064941 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:55:44.065064 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:55:44.065378 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:55:44.065381 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:55:44.065401 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:55:44.065570 (+ 169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:44.065581 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.066678 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.066682 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:44.068432 (+ 1750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:55:44.068446 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.069393 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.069397 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:55:44.069581 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:44.069672 (+ 91us) client_negotiation.cc:769] Sending connection context
0808 05:55:44.069794 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 05:55:44.069865 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":317,"spinlock_wait_cycles":20992,"thread_start_us":105,"threads_started":1}
I20260808 05:55:44.070914 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cdff82f44a5421f9f3020e496cb8df3" candidate_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a06f7c9cceb446db11f7ecf475553cf" is_pre_election: true
I20260808 05:55:44.071079 14452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cdff82f44a5421f9f3020e496cb8df3" candidate_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b347255ec0d745dd98e8974af653b599" is_pre_election: true
I20260808 05:55:44.071278 14598 raft_consensus.cc:2454] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d032c8e3cd3f4259837db79f2e9a42ca in term 0.
I20260808 05:55:44.071453 14452 raft_consensus.cc:2454] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d032c8e3cd3f4259837db79f2e9a42ca in term 0.
I20260808 05:55:44.071826 14236 leader_election.cc:302] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a06f7c9cceb446db11f7ecf475553cf, d032c8e3cd3f4259837db79f2e9a42ca; no voters:
I20260808 05:55:44.072137 14674 raft_consensus.cc:2781] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:55:44.072227 14674 raft_consensus.cc:482] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:55:44.072273 14674 raft_consensus.cc:3037] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:44.073485 14674 raft_consensus.cc:504] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:44.073869 14674 leader_election.cc:288] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [CANDIDATE]: Term 1 election: Requested vote from peers 2a06f7c9cceb446db11f7ecf475553cf (127.2.191.67:46773), b347255ec0d745dd98e8974af653b599 (127.2.191.66:46845)
I20260808 05:55:44.074323 14598 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cdff82f44a5421f9f3020e496cb8df3" candidate_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a06f7c9cceb446db11f7ecf475553cf"
I20260808 05:55:44.074331 14452 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3cdff82f44a5421f9f3020e496cb8df3" candidate_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b347255ec0d745dd98e8974af653b599"
I20260808 05:55:44.074499 14598 raft_consensus.cc:3037] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:44.074506 14452 raft_consensus.cc:3037] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:55:44.075609 14598 raft_consensus.cc:2454] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d032c8e3cd3f4259837db79f2e9a42ca in term 1.
I20260808 05:55:44.075765 14452 raft_consensus.cc:2454] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d032c8e3cd3f4259837db79f2e9a42ca in term 1.
I20260808 05:55:44.075984 14236 leader_election.cc:302] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a06f7c9cceb446db11f7ecf475553cf, d032c8e3cd3f4259837db79f2e9a42ca; no voters:
I20260808 05:55:44.076290 14674 raft_consensus.cc:2781] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:55:44.076521 14674 raft_consensus.cc:686] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [term 1 LEADER]: Becoming Leader. State: Replica: d032c8e3cd3f4259837db79f2e9a42ca, State: Running, Role: LEADER
I20260808 05:55:44.077255 14674 consensus_queue.cc:237] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } }
I20260808 05:55:44.081013 14146 catalog_manager.cc:5495] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca reported cstate change: term changed from 0 to 1, leader changed from <none> to d032c8e3cd3f4259837db79f2e9a42ca (127.2.191.65). New cstate: current_term: 1 leader_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d032c8e3cd3f4259837db79f2e9a42ca" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 43551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 } health_report { overall_health: UNKNOWN } } }
I20260808 05:55:44.098399 14662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:44.095051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47452 (local address 127.2.191.65:43551)
0808 05:55:44.095194 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 05:55:44.095197 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:55:44.095211 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:55:44.095286 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:55:44.095288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:55:44.095342 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:55:44.095434 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:55:44.095644 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.096137 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.097044 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:55:44.097276 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:55:44.097360 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:55:44.097628 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:55:44.098052 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:55:44.098148 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 05:55:44.098227 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 05:55:44.098280 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 05:55:44.104462 14452 raft_consensus.cc:1261] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 1 FOLLOWER]: Refusing update from remote peer d032c8e3cd3f4259837db79f2e9a42ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:44.104461 14598 raft_consensus.cc:1261] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 1 FOLLOWER]: Refusing update from remote peer d032c8e3cd3f4259837db79f2e9a42ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:55:44.105293 14677 consensus_queue.cc:1035] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a06f7c9cceb446db11f7ecf475553cf" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 46773 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:44.105516 14674 consensus_queue.cc:1035] T 3cdff82f44a5421f9f3020e496cb8df3 P d032c8e3cd3f4259837db79f2e9a42ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b347255ec0d745dd98e8974af653b599" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 46845 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:55:44.113569 14680 mvcc.cc:205] Tried to move back new op lower bound from 7316146356644384768 to 7316146356544167936. Current Snapshot: MvccSnapshot[applied={T|T < 7316146356644384768}]
I20260808 05:55:44.116173 14682 mvcc.cc:205] Tried to move back new op lower bound from 7316146356644384768 to 7316146356544167936. Current Snapshot: MvccSnapshot[applied={T|T < 7316146356644384768}]
I20260808 05:55:44.124781 14146 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:44.124989 14146 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34852:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:55:44.127611 14146 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 366b2424331d4bc1892ac654eba00f5e: Sending DeleteTablet for 3 replicas of tablet 3cdff82f44a5421f9f3020e496cb8df3
I20260808 05:55:44.128474 14285 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cdff82f44a5421f9f3020e496cb8df3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:44 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:47446
I20260808 05:55:44.128654 14577 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cdff82f44a5421f9f3020e496cb8df3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:44 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:51174
I20260808 05:55:44.129212 14690 tablet_replica.cc:330] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: stopping tablet replica
I20260808 05:55:44.129261 14429 tablet_service.cc:1514] Processing DeleteTablet for tablet 3cdff82f44a5421f9f3020e496cb8df3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:55:44 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:48194
I20260808 05:55:44.129545 14690 raft_consensus.cc:2229] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:44.129560 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 14215
I20260808 05:55:44.131424 14690 raft_consensus.cc:2258] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:44.132396 14691 tablet_replica.cc:330] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: stopping tablet replica
I20260808 05:55:44.132817 14691 raft_consensus.cc:2229] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:55:44.133178 14691 raft_consensus.cc:2258] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:55:44.134279 14690 ts_tablet_manager.cc:1905] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:44.134544 14691 ts_tablet_manager.cc:1905] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:55:44.137257 14691 ts_tablet_manager.cc:1918] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:44.137257 14690 ts_tablet_manager.cc:1918] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:55:44.137375 14691 log.cc:1196] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/3cdff82f44a5421f9f3020e496cb8df3
I20260808 05:55:44.137375 14690 log.cc:1196] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/3cdff82f44a5421f9f3020e496cb8df3
I20260808 05:55:44.137761 14690 ts_tablet_manager.cc:1939] T 3cdff82f44a5421f9f3020e496cb8df3 P 2a06f7c9cceb446db11f7ecf475553cf: Deleting consensus metadata
I20260808 05:55:44.137761 14691 ts_tablet_manager.cc:1939] T 3cdff82f44a5421f9f3020e496cb8df3 P b347255ec0d745dd98e8974af653b599: Deleting consensus metadata
W20260808 05:55:44.138515 14132 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:43551 (error 108)
I20260808 05:55:44.139117 14132 catalog_manager.cc:4841] TS b347255ec0d745dd98e8974af653b599 (127.2.191.66:46845): tablet 3cdff82f44a5421f9f3020e496cb8df3 (table test-table [id=bab8bab738a64dcb977b4696edeeda10]) successfully deleted
I20260808 05:55:44.139151 14131 catalog_manager.cc:4841] TS 2a06f7c9cceb446db11f7ecf475553cf (127.2.191.67:46773): tablet 3cdff82f44a5421f9f3020e496cb8df3 (table test-table [id=bab8bab738a64dcb977b4696edeeda10]) successfully deleted
I20260808 05:55:44.139639 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 14363
I20260808 05:55:44.139838 14658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:55:44.139492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:43551 (local address 127.0.0.1:47466)
0808 05:55:44.139648 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 05:55:44.139712 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:43551: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260808 05:55:44.141477 14132 catalog_manager.cc:4584] TS d032c8e3cd3f4259837db79f2e9a42ca (127.2.191.65:43551): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3cdff82f44a5421f9f3020e496cb8df3: Network error: Client connection negotiation failed: client connection to 127.2.191.65:43551: connect: Connection refused (error 111)
I20260808 05:55:44.147646 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 14504
I20260808 05:55:44.154808 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 14109
2026-08-08T05:55:44Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2435 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:55:44 dist-test-slave-qg60 krb5kdc[14695](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:55:44 dist-test-slave-qg60 krb5kdc[14695](info): set up 2 sockets
Aug 08 05:55:44 dist-test-slave-qg60 krb5kdc[14695](info): commencing operation
krb5kdc: starting...
W20260808 05:55:45.278538 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:55:45 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:55:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:55:45Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.2.191.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.2.191.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/rangeradmin_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/rangeradmin_127.2.191.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.2.191.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.2.191.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/rangerlookup_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/rangerlookup_127.2.191.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.2.191.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.2.191.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/HTTP_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/HTTP_127.2.191.84@KRBTEST.COM.keytab.
I20260808 05:55:45.469424 2813 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasklOEsuG/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/postgres -l logfile start
2026-08-08 05:55:48.138 UTC [14729] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 05:55:48.138 UTC [14729] LOG: listening on IPv4 address "127.2.191.84", port 41125
2026-08-08 05:55:48.142 UTC [14729] LOG: listening on Unix socket "/tmp/.s.PGSQL.41125"
2026-08-08 05:55:48.166 UTC [14732] LOG: database system was shut down at 2026-08-08 05:55:46 UTC
2026-08-08 05:55:48.171 UTC [14729] LOG: database system is ready to accept connections
I20260808 05:55:49.202602 2813 mini_postgres.cc:96] Postgres bound to 41125
2026-08-08 05:55:49.210 UTC [14740] FATAL: database "slave" does not exist
127.2.191.84:41125 - accepting connections
I20260808 05:55:49.211072 2813 mini_ranger.cc:161] Starting Ranger...
I20260808 05:55:49.227991 2813 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 05:55:49.740346 2813 mini_ranger.cc:87] Created ranger Postgres database
I20260808 05:55:49.740461 2813 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-admin
2026-08-08 05:55:50,046 [I] DB FLAVOR :POSTGRES
2026-08-08 05:55:50,047 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:55:50,047 [I] Checking connection..
2026-08-08 05:55:50,047 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 05:55:50,315 [I] Checking connection passed.
2026-08-08 05:55:50,316 [I] --------- Verifying version history table ---------
2026-08-08 05:55:50,316 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:55:50,575 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:55:50,575 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:55:50,830 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:55:50,830 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 05:55:50,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 05:55:51.101 UTC [14808] WARNING: there is no transaction in progress
2026-08-08 05:55:51,110 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 05:55:51,111 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:55:51,351 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 05:55:51,351 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:55:51,352 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 05:55:51,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 05:55:51,880 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-qg60.c.gcp-upstream.internal','N') ;"
2026-08-08 05:55:52,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:55:52,381 [I] Table x_portal_user does not exist in database ranger
2026-08-08 05:55:52,382 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:55:52,653 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 05:55:52,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:55:52,922 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:55:53,182 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 05:55:53,183 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 05:55:54.250 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.266 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.283 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.301 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.318 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.339 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.406 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.414 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.430 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.441 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.452 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.468 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.479 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.486 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.494 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:54.502 UTC [14924] WARNING: there is no transaction in progress
2026-08-08 05:55:55,223 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 05:55:55,223 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 05:55:55,492 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 05:55:55,492 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:55:55,765 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 05:55:55,765 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:55:56,022 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 05:55:56,022 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:55:56,277 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:55:56,536 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-qg60.c.gcp-upstream.internal';"
2026-08-08 05:55:56,776 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 05:55:56,777 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 05:55:57,037 [I] DB_PATCHES have already been applied
I20260808 05:55:57.043601 2813 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-admin:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasklOEsuG/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 05:55:57.043697 2813 mini_ranger.cc:193] Using host: 127.2.191.84
I20260808 05:55:57.048017 2813 mini_ranger.cc:227] Ranger admin URL: http://127.2.191.84:55473
Aug 08, 2026 5:55:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:55:57 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:55:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:55:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:55:57 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:55:58 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:55:58 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 05:55:58.241786 2813 mini_ranger.cc:160] Time spent starting Ranger: real 9.031s user 0.000s sys 0.013s
Aug 08, 2026 5:56:20 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:56:20 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 5:56:20 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:56:20 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:56:21 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 05:56:22.000698 2813 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.2.191.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.2.191.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/rangerkms_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/rangerkms_127.2.191.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.2.191.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.2.191.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.2.191.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/HTTP_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.2.191.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/HTTP_127.2.191.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 05:56:22 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168582, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 05:56:22.097541 2813 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 05:56:22.108590 2813 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 05:56:23.091140 2813 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 05:56:23.091256 2813 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms
I20260808 05:56:23.091372 2813 mini_ranger_kms.cc:227] Using postgres at 127.2.191.84:41125
2026-08-08 05:56:23,528 [I] DB FLAVOR :POSTGRES
2026-08-08 05:56:23,528 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:56:23,529 [I] Checking connection
2026-08-08 05:56:23,529 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 05:56:23,839 [I] connection success
2026-08-08 05:56:23,839 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 05:56:23,839 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 05:56:23,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 05:56:24,170 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 05:56:24,170 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:56:24,170 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 05:56:24,170 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:41125/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 05:56:24,465 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 05:56:25.000602 2813 mini_ranger_kms.cc:310] Created kms service
I20260808 05:56:25.197582 2813 mini_ranger_kms.cc:326] Created kudu user
I20260808 05:56:25.244251 2813 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 05:56:25 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168582, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:56:25.686928 2813 mini_ranger_kms.cc:384] Added ranger policy
I20260808 05:56:25.687089 2813 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms:/tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 05:56:25.687115 2813 mini_ranger_kms.cc:240] Using host: 127.2.191.84
I20260808 05:56:25.691864 2813 mini_ranger_kms.cc:276] Ranger KMS PID: 15126
I20260808 05:56:25.692016 2813 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.2.191.84:58059
Aug 08, 2026 5:56:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:56:26 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:56:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:56:26 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:56:27 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 05:56:28.019244 2813 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.922s user 0.025s sys 0.391s
I20260808 05:56:28.019402 2813 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 05:56:28.019534 2813 mini_ranger_kms.cc:401] 127.2.191.84:58059/kms/v1/keys
Aug 08 05:56:28 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786168588, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.191.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 05:56:28 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168588, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.191.84@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
Aug 08 05:56:29 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168588, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.191.84@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
Aug 08 05:56:31 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:56:31.540720 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:41237
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:38909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:41237
--ranger_config_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:58059/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:56:31.667132 15183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:56:31.667537 15183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:56:31.667642 15183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:56:31.671873 15183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:56:31.671939 15183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:56:31.671959 15183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:56:31.671976 15183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:56:31.671994 15183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:56:31.677868 15183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/wal
--ranger_kms_url=127.2.191.84:58059/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:41237
--ranger_config_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:41237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15183
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:56:31.679039 15183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:56:31.680233 15183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:56:31.690974 15183 server_base.cc:1034] running on GCE node
W20260808 05:56:31.691138 15190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:56:31.691212 15192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:56:31.691257 15189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:56:31.692016 15183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:56:31.693305 15183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:56:31.694490 15183 hybrid_clock.cc:648] HybridClock initialized: now 1786168591694467 us; error 46 us; skew 500 ppm
Aug 08 05:56:31 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168591, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:56:31.702593 15183 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:56:31.703723 15183 webserver.cc:460] Webserver started at http://127.2.191.126:41801/ using document root <none> and password file <none>
I20260808 05:56:31.704335 15183 fs_manager.cc:359] Metadata directory not provided
I20260808 05:56:31.704394 15183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:56:31.704628 15183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:56:31 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168591, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:56:31.772902 15183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "c713209bbb924bba8a87659c94717fde"
format_stamp: "Formatted at 2026-08-08 05:56:31 on dist-test-slave-qg60"
server_key: "d1a67e9c9ad8286ac5f54c1486d299f4"
server_key_iv: "e1f9a73275597ee4f116ce74a93f1e0e"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:31.773589 15183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "c713209bbb924bba8a87659c94717fde"
format_stamp: "Formatted at 2026-08-08 05:56:31 on dist-test-slave-qg60"
server_key: "d1a67e9c9ad8286ac5f54c1486d299f4"
server_key_iv: "e1f9a73275597ee4f116ce74a93f1e0e"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:31.777784 15183 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:56:31.796852 15199 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:31.798406 15183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 05:56:31.798544 15183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "c713209bbb924bba8a87659c94717fde"
format_stamp: "Formatted at 2026-08-08 05:56:31 on dist-test-slave-qg60"
server_key: "d1a67e9c9ad8286ac5f54c1486d299f4"
server_key_iv: "e1f9a73275597ee4f116ce74a93f1e0e"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:31.798689 15183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:56:31.811570 15183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:56:31.814649 15183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:56:31.814852 15183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:56:31.823541 15183 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:41237
I20260808 05:56:31.823565 15254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:41237 every 8 connection(s)
I20260808 05:56:31.824542 15183 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:56:31.828047 15256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:56:31.830068 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 15183
I20260808 05:56:31.830260 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:56:31.830557 2813 external_mini_cluster.cc:1428] Setting key fb8c54b6b0f20240efdf663eacf8b3de
I20260808 05:56:31.835887 15256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde: Bootstrap starting.
I20260808 05:56:31.839128 15256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde: Neither blocks nor log segments found. Creating new log.
Aug 08 05:56:31 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:56:31.840389 15256 log.cc:824] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde: Log is configured to *not* fsync() on all Append() calls
I20260808 05:56:31.842935 15256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde: No bootstrap required, opened a new log
I20260808 05:56:31.845589 15259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:31.832112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44492 (local address 127.2.191.126:41237)
0808 05:56:31.832542 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:31.832600 (+ 58us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:31.832640 (+ 40us) server_negotiation.cc:407] Connection header received
0808 05:56:31.833362 (+ 722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:31.833381 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:31.833738 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:31.834076 (+ 338us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:56:31.834907 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:31.835903 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:31.836879 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:31.837342 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:31.837504 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:31.840171 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:56:31.840176 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:56:31.840191 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:56:31.840218 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:56:31.842703 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:31.843198 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:31.843208 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:31.843213 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:31.843315 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:31.843593 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:31.843596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:31.843598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:31.844049 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:56:31.844266 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:31.844522 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 05:56:31.844849 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":146,"threads_started":1}
I20260808 05:56:31.847862 15256 raft_consensus.cc:348] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c713209bbb924bba8a87659c94717fde" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41237 } }
I20260808 05:56:31.848182 15256 raft_consensus.cc:374] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:56:31.848255 15256 raft_consensus.cc:729] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c713209bbb924bba8a87659c94717fde, State: Initialized, Role: FOLLOWER
I20260808 05:56:31.848820 15256 consensus_queue.cc:260] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c713209bbb924bba8a87659c94717fde" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41237 } }
I20260808 05:56:31.849023 15256 raft_consensus.cc:388] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:56:31.849102 15256 raft_consensus.cc:482] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:56:31.849206 15256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:56:31.850864 15256 raft_consensus.cc:504] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c713209bbb924bba8a87659c94717fde" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41237 } }
I20260808 05:56:31.851257 15256 leader_election.cc:302] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c713209bbb924bba8a87659c94717fde; no voters:
I20260808 05:56:31.851672 15256 leader_election.cc:288] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:56:31.851794 15262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:56:31.852090 15262 raft_consensus.cc:686] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [term 1 LEADER]: Becoming Leader. State: Replica: c713209bbb924bba8a87659c94717fde, State: Running, Role: LEADER
I20260808 05:56:31.852479 15262 consensus_queue.cc:237] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c713209bbb924bba8a87659c94717fde" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41237 } }
I20260808 05:56:31.853163 15256 sys_catalog.cc:564] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:56:31.855212 15263 sys_catalog.cc:455] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c713209bbb924bba8a87659c94717fde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c713209bbb924bba8a87659c94717fde" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41237 } } }
I20260808 05:56:31.855345 15263 sys_catalog.cc:458] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [sys.catalog]: This master's current role is: LEADER
I20260808 05:56:31.855878 15264 sys_catalog.cc:455] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [sys.catalog]: SysCatalogTable state changed. Reason: New leader c713209bbb924bba8a87659c94717fde. Latest consensus state: current_term: 1 leader_uuid: "c713209bbb924bba8a87659c94717fde" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c713209bbb924bba8a87659c94717fde" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41237 } } }
I20260808 05:56:31.855973 15264 sys_catalog.cc:458] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde [sys.catalog]: This master's current role is: LEADER
I20260808 05:56:31.856441 15271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:56:31.856889 15256 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 05:56:31.865407 15271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:56:31.874560 15271 catalog_manager.cc:1347] Generated new cluster ID: f289a3195bbc4989a196e8608d3154e8
I20260808 05:56:31.874648 15271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:56:31.895624 15271 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:56:31.897303 15271 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:56:31.913136 15271 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde: Generated new TSK 0
I20260808 05:56:31.914408 15271 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:56:32.800518 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:58059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41237
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:38909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:56:32.955417 15305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:56:32.955859 15305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:56:32.956054 15305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:56:32.962942 15305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:56:32.963025 15305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:56:32.963141 15305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:56:32.970151 15305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.2.191.84:58059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:56:32.971539 15305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:56:32.973096 15305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:56:32.987226 15312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:56:32.987412 15305 server_base.cc:1034] running on GCE node
W20260808 05:56:32.987234 15315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:56:32.987478 15313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:56:32.988183 15305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:56:32.988965 15305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:56:32.990147 15305 hybrid_clock.cc:648] HybridClock initialized: now 1786168592990133 us; error 32 us; skew 500 ppm
Aug 08 05:56:32 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168592, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:56:32.994309 15305 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:56:32.995573 15305 webserver.cc:460] Webserver started at http://127.2.191.65:42079/ using document root <none> and password file <none>
I20260808 05:56:32.996333 15305 fs_manager.cc:359] Metadata directory not provided
I20260808 05:56:32.996428 15305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:56:32.996666 15305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:56:32 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168592, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:56:33.016208 15305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "66081947fb4743bcb5034a5f9470f2bd"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "497321771f2642fc5e25538cc7c64ac2"
server_key_iv: "af43b5f91c95799d0597566a071d9f96"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.017104 15305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "66081947fb4743bcb5034a5f9470f2bd"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "497321771f2642fc5e25538cc7c64ac2"
server_key_iv: "af43b5f91c95799d0597566a071d9f96"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.030861 15305 fs_manager.cc:691] Time spent creating directory manager: real 0.013s user 0.004s sys 0.000s
I20260808 05:56:33.050923 15322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:33.052990 15305 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:56:33.053228 15305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "66081947fb4743bcb5034a5f9470f2bd"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "497321771f2642fc5e25538cc7c64ac2"
server_key_iv: "af43b5f91c95799d0597566a071d9f96"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.053396 15305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:56:33.076030 15305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:56:33.080631 15305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:56:33.080971 15305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:56:33.081805 15305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:56:33.083333 15305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:56:33.083444 15305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:33.083581 15305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:56:33.083673 15305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:33.096565 15305 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:39325
I20260808 05:56:33.096589 15443 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:39325 every 8 connection(s)
I20260808 05:56:33.097743 15305 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:56:33.101325 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 15305
I20260808 05:56:33.101475 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:56:33.101816 2813 external_mini_cluster.cc:1428] Setting key 63590b5d350c68d6740f79a6edec60e8
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168592, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:56:33.124045 15449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.102139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41237 (local address 127.2.191.65:36879)
0808 05:56:33.102723 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:33.102783 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 05:56:33.103818 (+ 1035us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:56:33.105896 (+ 2078us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:56:33.105910 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:56:33.106369 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:56:33.107192 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:33.107221 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.108163 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.108168 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:33.110316 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:33.110346 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.111450 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.111456 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:33.111797 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:33.112877 (+ 1080us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:56:33.112907 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:56:33.115665 (+ 2758us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:56:33.119498 (+ 3833us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:56:33.119507 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:56:33.119529 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:56:33.120008 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:56:33.120404 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:56:33.120408 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:56:33.120409 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:56:33.120663 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:56:33.121295 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:56:33.121302 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:56:33.121754 (+ 452us) client_negotiation.cc:769] Sending connection context
0808 05:56:33.122022 (+ 268us) client_negotiation.cc:240] Negotiation successful
0808 05:56:33.122761 (+ 739us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":158,"threads_started":1}
I20260808 05:56:33.125031 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.101567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:36879 (local address 127.2.191.126:41237)
0808 05:56:33.104977 (+ 3410us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:33.104984 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:33.105002 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:56:33.105063 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:33.105069 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:33.105132 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:33.105281 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:56:33.107400 (+ 2119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.108006 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.110636 (+ 2630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.111147 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.112344 (+ 1197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:33.116020 (+ 3676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:56:33.116026 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:56:33.116029 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:56:33.116073 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:56:33.119295 (+ 3222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:33.120167 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:33.120170 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:33.120172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:33.120275 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:33.120818 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:33.120822 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:33.120824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:33.121137 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:56:33.124511 (+ 3374us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:33.124646 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 05:56:33.124838 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3294,"thread_start_us":65,"threads_started":1}
I20260808 05:56:33.126911 15444 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41237
I20260808 05:56:33.127210 15444 heartbeater.cc:464] Registering TS with master...
I20260808 05:56:33.127882 15444 heartbeater.cc:511] Master 127.2.191.126:41237 requested a full tablet report, sending...
I20260808 05:56:33.129904 15216 ts_manager.cc:194] Registered new tserver with Master: 66081947fb4743bcb5034a5f9470f2bd (127.2.191.65:39325)
I20260808 05:56:33.131501 15216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:36879
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:56:33.152432 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:58059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41237
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:38909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 05:56:33.302532 15452 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:56:33.302825 15452 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:56:33.302874 15452 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:56:33.307170 15452 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:56:33.307248 15452 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:56:33.307348 15452 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:56:33.312922 15452 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.2.191.84:58059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15452
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:56:33.314180 15452 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:56:33.315412 15452 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:56:33.326202 15459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:56:33.326356 15458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:56:33.326894 15461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:56:33.328027 15452 server_base.cc:1034] running on GCE node
I20260808 05:56:33.328649 15452 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:56:33.329619 15452 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:56:33.330869 15452 hybrid_clock.cc:648] HybridClock initialized: now 1786168593330781 us; error 107 us; skew 500 ppm
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:56:33.334193 15452 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:56:33.335585 15452 webserver.cc:460] Webserver started at http://127.2.191.66:42941/ using document root <none> and password file <none>
I20260808 05:56:33.336202 15452 fs_manager.cc:359] Metadata directory not provided
I20260808 05:56:33.336302 15452 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:56:33.336577 15452 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:56:33.352520 15452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "8673dafa11fa43998d4e68033351cbed"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "937008f6c6b24df60bd8c913295f2f73"
server_key_iv: "d7a99d1f1594c45fd30050b43db72cd4"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.353538 15452 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "8673dafa11fa43998d4e68033351cbed"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "937008f6c6b24df60bd8c913295f2f73"
server_key_iv: "d7a99d1f1594c45fd30050b43db72cd4"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.361295 15452 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.004s sys 0.000s
I20260808 05:56:33.377424 15468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:33.379130 15452 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:56:33.379276 15452 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "8673dafa11fa43998d4e68033351cbed"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "937008f6c6b24df60bd8c913295f2f73"
server_key_iv: "d7a99d1f1594c45fd30050b43db72cd4"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.379426 15452 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:56:33.409516 15452 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:56:33.413520 15452 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:56:33.413829 15452 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:56:33.414748 15452 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:56:33.415993 15452 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:56:33.416108 15452 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:33.416217 15452 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:56:33.416288 15452 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:33.432533 15452 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:44835
I20260808 05:56:33.433926 15452 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:56:33.437681 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 15452
I20260808 05:56:33.437825 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:56:33.438138 2813 external_mini_cluster.cc:1428] Setting key b95a22dcec9867dc21f2e33903750559
I20260808 05:56:33.435472 15591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:44835 every 8 connection(s)
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:56:33.473959 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.444154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:34497 (local address 127.2.191.126:41237)
0808 05:56:33.444291 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:33.444295 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:33.453788 (+ 9493us) server_negotiation.cc:407] Connection header received
0808 05:56:33.455770 (+ 1982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:33.455775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:33.455862 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:33.455923 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:56:33.458003 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.459004 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.463755 (+ 4751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.464275 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.464385 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:33.468271 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:56:33.468277 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:56:33.468280 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:56:33.468317 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:56:33.470477 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:33.471300 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:33.471305 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:33.471307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:33.471415 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:33.472188 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:33.472192 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:33.472194 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:33.472582 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:56:33.472691 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:33.473563 (+ 872us) server_negotiation.cc:299] Negotiation successful
0808 05:56:33.473737 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:56:33.476146 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.444807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41237 (local address 127.2.191.66:34497)
0808 05:56:33.453557 (+ 8750us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:33.453644 (+ 87us) client_negotiation.cc:174] Beginning negotiation
0808 05:56:33.455440 (+ 1796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:56:33.456436 (+ 996us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:56:33.456446 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:56:33.456919 (+ 473us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:56:33.457653 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:33.457674 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.459180 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.459183 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:33.463471 (+ 4288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:33.463488 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.464659 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.464663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:33.464954 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:33.465783 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:56:33.465809 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:56:33.467989 (+ 2180us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:56:33.470658 (+ 2669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:56:33.470666 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:56:33.470688 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:56:33.471151 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:56:33.471558 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:56:33.471561 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:56:33.471563 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:56:33.471952 (+ 389us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:56:33.472799 (+ 847us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:56:33.472807 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:56:33.473223 (+ 416us) client_negotiation.cc:769] Sending connection context
0808 05:56:33.474509 (+ 1286us) client_negotiation.cc:240] Negotiation successful
0808 05:56:33.474947 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8376,"thread_start_us":226,"threads_started":1}
I20260808 05:56:33.478943 15592 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41237
I20260808 05:56:33.479259 15592 heartbeater.cc:464] Registering TS with master...
I20260808 05:56:33.479975 15592 heartbeater.cc:511] Master 127.2.191.126:41237 requested a full tablet report, sending...
I20260808 05:56:33.481441 15216 ts_manager.cc:194] Registered new tserver with Master: 8673dafa11fa43998d4e68033351cbed (127.2.191.66:44835)
I20260808 05:56:33.482321 15216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:34497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:56:33.505471 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:58059/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41237
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:38909
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:56:33.685882 15597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:56:33.686375 15597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:56:33.686498 15597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:56:33.692801 15597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:56:33.692963 15597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:56:33.693123 15597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:56:33.701438 15597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38909
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.2.191.84:58059/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:56:33.703105 15597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:56:33.704542 15597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:56:33.719007 15603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:56:33.719041 15605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:56:33.720748 15597 server_base.cc:1034] running on GCE node
W20260808 05:56:33.721040 15602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:56:33.721633 15597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:56:33.722553 15597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:56:33.725836 15597 hybrid_clock.cc:648] HybridClock initialized: now 1786168593725755 us; error 90 us; skew 500 ppm
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:56:33.730250 15597 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:56:33.731528 15597 webserver.cc:460] Webserver started at http://127.2.191.67:44461/ using document root <none> and password file <none>
I20260808 05:56:33.732357 15597 fs_manager.cc:359] Metadata directory not provided
I20260808 05:56:33.732517 15597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:56:33.732878 15597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:56:33.759003 15597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "a2f64ae7693a4e3584781643e7fd7288"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "613121f797d375c9b013bd16ee74cbd9"
server_key_iv: "73657f81df2b77bb34b84acdc09fcd96"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.760571 15597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "a2f64ae7693a4e3584781643e7fd7288"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "613121f797d375c9b013bd16ee74cbd9"
server_key_iv: "73657f81df2b77bb34b84acdc09fcd96"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.766599 15597 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260808 05:56:33.794764 15612 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:33.796631 15597 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.003s sys 0.000s
I20260808 05:56:33.796797 15597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "a2f64ae7693a4e3584781643e7fd7288"
format_stamp: "Formatted at 2026-08-08 05:56:33 on dist-test-slave-qg60"
server_key: "613121f797d375c9b013bd16ee74cbd9"
server_key_iv: "73657f81df2b77bb34b84acdc09fcd96"
server_key_version: "kuduclusterkey@0"
I20260808 05:56:33.796952 15597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:56:33.850598 15597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:56:33.855247 15597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:56:33.855597 15597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:56:33.856415 15597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:56:33.857698 15597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:56:33.857820 15597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:56:33.857933 15597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:56:33.858218 15597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:56:33.881424 15597 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:43779
I20260808 05:56:33.882838 15597 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:56:33.891355 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 15597
I20260808 05:56:33.891515 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:56:33.891870 2813 external_mini_cluster.cc:1428] Setting key 4b1b0bddbdf95fe39a39973cc45ee1f3
Aug 08 05:56:33 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:56:33.904986 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.889021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:60133 (local address 127.2.191.126:41237)
0808 05:56:33.889168 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:33.889173 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:33.890655 (+ 1482us) server_negotiation.cc:407] Connection header received
0808 05:56:33.891979 (+ 1324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:33.891983 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:33.892062 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:33.892120 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:56:33.893935 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.894781 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.896588 (+ 1807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.896959 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.897046 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:33.900533 (+ 3487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:56:33.900538 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:56:33.900541 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:56:33.900571 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:56:33.902388 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:33.903074 (+ 686us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:33.903078 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:33.903080 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:33.903173 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:33.903611 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:33.903615 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:33.903617 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:33.903861 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:56:33.903933 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:33.904653 (+ 720us) server_negotiation.cc:299] Negotiation successful
0808 05:56:33.904814 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:56:33.906647 15738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.887664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41237 (local address 127.2.191.67:60133)
0808 05:56:33.890480 (+ 2816us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:33.890542 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 05:56:33.891703 (+ 1161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:56:33.892551 (+ 848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:56:33.892560 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:56:33.893053 (+ 493us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:56:33.893764 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:33.893782 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.894945 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.894948 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:33.896438 (+ 1490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:33.896449 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.897379 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.897383 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:33.897646 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:33.898434 (+ 788us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:56:33.898455 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:56:33.900330 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:56:33.902536 (+ 2206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:56:33.902543 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:56:33.902561 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:56:33.902935 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:56:33.903286 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:56:33.903289 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:56:33.903291 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:56:33.903497 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:56:33.904019 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:56:33.904037 (+ 18us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:56:33.904365 (+ 328us) client_negotiation.cc:769] Sending connection context
0808 05:56:33.905170 (+ 805us) client_negotiation.cc:240] Negotiation successful
0808 05:56:33.905540 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2561,"thread_start_us":247,"threads_started":1}
I20260808 05:56:33.908576 15736 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41237
I20260808 05:56:33.908864 15736 heartbeater.cc:464] Registering TS with master...
I20260808 05:56:33.909497 15736 heartbeater.cc:511] Master 127.2.191.126:41237 requested a full tablet report, sending...
I20260808 05:56:33.910784 15216 ts_manager.cc:194] Registered new tserver with Master: a2f64ae7693a4e3584781643e7fd7288 (127.2.191.67:43779)
I20260808 05:56:33.911548 15216 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:60133
I20260808 05:56:33.914189 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:56:33.884657 15735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:43779 every 8 connection(s)
I20260808 05:56:33.962001 15447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.921317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36860 (local address 127.2.191.126:41237)
0808 05:56:33.921464 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:33.921470 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:33.935233 (+ 13763us) server_negotiation.cc:407] Connection header received
0808 05:56:33.936803 (+ 1570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:33.936809 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:33.936891 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:33.936963 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:56:33.943758 (+ 6795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.944655 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.946058 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:33.946411 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:33.946505 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:33.952903 (+ 6398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:56:33.952907 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:56:33.952911 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:56:33.952952 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:56:33.955021 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:33.955636 (+ 615us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:33.955640 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:33.955642 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:33.955739 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:56:33.960849 (+ 5110us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:56:33.960854 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:56:33.960856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:56:33.961134 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:56:33.961260 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:33.961668 (+ 408us) server_negotiation.cc:299] Negotiation successful
0808 05:56:33.961818 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 05:56:33.966431 15216 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36860:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:56:33.971100 15216 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:56:34.008358 15751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.993760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39325 (local address 127.0.0.1:49510)
0808 05:56:34.002273 (+ 8513us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:34.002353 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 05:56:34.002564 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:56:34.003440 (+ 876us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:56:34.003460 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:56:34.003484 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:56:34.003604 (+ 120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.003609 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.005108 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.005112 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.006615 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.006625 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.007784 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.007788 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.007915 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.007965 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 05:56:34.008055 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:56:34.008177 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8255,"mutex_wait_us":4,"thread_start_us":131,"threads_started":1}
I20260808 05:56:34.009542 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:33.993922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49510 (local address 127.2.191.65:39325)
0808 05:56:33.994256 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:33.994264 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:34.002495 (+ 8231us) server_negotiation.cc:407] Connection header received
0808 05:56:34.002819 (+ 324us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:34.002825 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:34.003137 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:34.003304 (+ 167us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:56:34.003731 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.004946 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.006774 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.007648 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.009076 (+ 1428us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.009240 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:34.009296 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 05:56:34.009395 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":220,"thread_start_us":123,"threads_started":1}
I20260808 05:56:34.010423 15754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.001983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:43779 (local address 127.0.0.1:45282)
0808 05:56:34.005108 (+ 3125us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:34.005124 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:56:34.005245 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:56:34.005945 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:56:34.005948 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:56:34.005965 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:56:34.006048 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.006053 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.007514 (+ 1461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.007518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.008663 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.008673 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.010022 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.010027 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.010121 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.010144 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 05:56:34.010214 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 05:56:34.010281 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3033,"thread_start_us":138,"threads_started":1}
I20260808 05:56:34.010926 15756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.003012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45282 (local address 127.2.191.67:43779)
0808 05:56:34.003918 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:34.003931 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:34.005342 (+ 1411us) server_negotiation.cc:407] Connection header received
0808 05:56:34.005423 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:34.005428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:34.005613 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:34.005804 (+ 191us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:56:34.006186 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.007375 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.008883 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.009718 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.009823 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.009961 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:34.010678 (+ 717us) server_negotiation.cc:299] Negotiation successful
0808 05:56:34.010783 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":801,"thread_start_us":152,"threads_started":1}
I20260808 05:56:34.015041 15753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.001678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:44835 (local address 127.0.0.1:46744)
0808 05:56:34.002272 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:34.002352 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0808 05:56:34.002513 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:56:34.009841 (+ 7328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:56:34.009844 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:56:34.009865 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:56:34.009949 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.009954 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.012190 (+ 2236us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.012194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.013332 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.013343 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.014631 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.014635 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.014741 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.014764 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 05:56:34.014838 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:56:34.014908 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":161,"threads_started":1}
I20260808 05:56:34.014652 15354 tablet_service.cc:1467] Processing CreateTablet for tablet 371ca4f245d7430082cd2bd785a05d87 (DEFAULT_TABLE table=test-table [id=88ee5c8901e546b7a41abd0d430ba0d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:56:34.014659 15665 tablet_service.cc:1467] Processing CreateTablet for tablet 371ca4f245d7430082cd2bd785a05d87 (DEFAULT_TABLE table=test-table [id=88ee5c8901e546b7a41abd0d430ba0d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:56:34.015643 15755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.002373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46744 (local address 127.2.191.66:44835)
0808 05:56:34.004196 (+ 1823us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:34.004202 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:34.004225 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:56:34.004298 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:34.004303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:34.004493 (+ 190us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:34.004779 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:56:34.010107 (+ 5328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.011259 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.013491 (+ 2232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.014303 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.014414 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.014550 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:34.015353 (+ 803us) server_negotiation.cc:299] Negotiation successful
0808 05:56:34.015461 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1717,"thread_start_us":180,"threads_started":1}
I20260808 05:56:34.015914 15665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 371ca4f245d7430082cd2bd785a05d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:56:34.016105 15354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 371ca4f245d7430082cd2bd785a05d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:56:34.019075 15518 tablet_service.cc:1467] Processing CreateTablet for tablet 371ca4f245d7430082cd2bd785a05d87 (DEFAULT_TABLE table=test-table [id=88ee5c8901e546b7a41abd0d430ba0d8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:56:34.020388 15518 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 371ca4f245d7430082cd2bd785a05d87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:56:34.025904 15757 tablet_bootstrap.cc:492] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Bootstrap starting.
I20260808 05:56:34.029348 15757 tablet_bootstrap.cc:654] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Neither blocks nor log segments found. Creating new log.
I20260808 05:56:34.029618 15759 tablet_bootstrap.cc:492] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: Bootstrap starting.
I20260808 05:56:34.030507 15757 log.cc:824] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Log is configured to *not* fsync() on all Append() calls
I20260808 05:56:34.031934 15758 tablet_bootstrap.cc:492] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd: Bootstrap starting.
I20260808 05:56:34.032318 15759 tablet_bootstrap.cc:654] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: Neither blocks nor log segments found. Creating new log.
I20260808 05:56:34.033607 15759 log.cc:824] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: Log is configured to *not* fsync() on all Append() calls
I20260808 05:56:34.034935 15758 tablet_bootstrap.cc:654] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd: Neither blocks nor log segments found. Creating new log.
I20260808 05:56:34.036080 15758 log.cc:824] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd: Log is configured to *not* fsync() on all Append() calls
I20260808 05:56:34.036847 15757 tablet_bootstrap.cc:492] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: No bootstrap required, opened a new log
I20260808 05:56:34.037077 15757 ts_tablet_manager.cc:1397] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.000s
I20260808 05:56:34.038318 15758 tablet_bootstrap.cc:492] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd: No bootstrap required, opened a new log
I20260808 05:56:34.038502 15758 ts_tablet_manager.cc:1397] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260808 05:56:34.042155 15757 raft_consensus.cc:348] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.042619 15757 raft_consensus.cc:374] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:56:34.042773 15757 raft_consensus.cc:729] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2f64ae7693a4e3584781643e7fd7288, State: Initialized, Role: FOLLOWER
I20260808 05:56:34.043334 15757 consensus_queue.cc:260] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.043562 15758 raft_consensus.cc:348] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.043889 15758 raft_consensus.cc:374] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:56:34.043991 15758 raft_consensus.cc:729] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66081947fb4743bcb5034a5f9470f2bd, State: Initialized, Role: FOLLOWER
I20260808 05:56:34.044476 15758 consensus_queue.cc:260] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.044621 15757 ts_tablet_manager.cc:1428] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 05:56:34.045289 15736 heartbeater.cc:503] Master 127.2.191.126:41237 was elected leader, sending a full tablet report...
I20260808 05:56:34.045544 15758 ts_tablet_manager.cc:1428] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd: Time spent starting tablet: real 0.007s user 0.003s sys 0.004s
I20260808 05:56:34.046348 15444 heartbeater.cc:503] Master 127.2.191.126:41237 was elected leader, sending a full tablet report...
I20260808 05:56:34.046751 15759 tablet_bootstrap.cc:492] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: No bootstrap required, opened a new log
I20260808 05:56:34.046950 15759 ts_tablet_manager.cc:1397] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.004s
I20260808 05:56:34.052009 15759 raft_consensus.cc:348] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.052417 15759 raft_consensus.cc:374] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:56:34.052631 15759 raft_consensus.cc:729] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8673dafa11fa43998d4e68033351cbed, State: Initialized, Role: FOLLOWER
I20260808 05:56:34.053144 15759 consensus_queue.cc:260] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.054247 15759 ts_tablet_manager.cc:1428] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 05:56:34.054287 15592 heartbeater.cc:503] Master 127.2.191.126:41237 was elected leader, sending a full tablet report...
W20260808 05:56:34.100092 15445 tablet.cc:2369] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:56:34.140476 15737 tablet.cc:2369] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:56:34.194796 15593 tablet.cc:2369] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 05:56:34 dist-test-slave-qg60 krb5kdc[14695](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168593, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:56:34.264318 15767 raft_consensus.cc:482] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:56:34.264605 15767 raft_consensus.cc:504] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.266149 15767 leader_election.cc:288] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66081947fb4743bcb5034a5f9470f2bd (127.2.191.65:39325), a2f64ae7693a4e3584781643e7fd7288 (127.2.191.67:43779)
I20260808 05:56:34.273094 15752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.266810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:49877 (local address 127.2.191.65:39325)
0808 05:56:34.266981 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:34.266987 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:34.267589 (+ 602us) server_negotiation.cc:407] Connection header received
0808 05:56:34.267802 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:34.267806 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:34.267854 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:34.267902 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:56:34.269214 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.270009 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.271729 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.272322 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.272420 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.272485 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:34.272868 (+ 383us) server_negotiation.cc:299] Negotiation successful
0808 05:56:34.272949 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:56:34.273810 15770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.266454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39325 (local address 127.2.191.66:49877)
0808 05:56:34.267498 (+ 1044us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:34.267514 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:56:34.267675 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:56:34.268049 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:56:34.268052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:56:34.268240 (+ 188us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:56:34.269067 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.269082 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.270262 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.270265 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.271586 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.271597 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.272597 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.272600 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.272704 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.272747 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 05:56:34.273512 (+ 765us) client_negotiation.cc:240] Negotiation successful
0808 05:56:34.273594 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":965,"spinlock_wait_cycles":38272,"thread_start_us":772,"threads_started":1}
I20260808 05:56:34.274638 15395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "371ca4f245d7430082cd2bd785a05d87" candidate_uuid: "8673dafa11fa43998d4e68033351cbed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66081947fb4743bcb5034a5f9470f2bd" is_pre_election: true
I20260808 05:56:34.274984 15395 raft_consensus.cc:2454] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8673dafa11fa43998d4e68033351cbed in term 0.
I20260808 05:56:34.275327 15756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.266899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:53827 (local address 127.2.191.67:43779)
0808 05:56:34.267103 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:34.267110 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:34.270306 (+ 3196us) server_negotiation.cc:407] Connection header received
0808 05:56:34.270648 (+ 342us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:34.270652 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:34.270711 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:34.270792 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:56:34.271251 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.272003 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.273934 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.274573 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.274702 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.274758 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:34.275113 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 05:56:34.275200 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260808 05:56:34.275770 15771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.266494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:43779 (local address 127.2.191.66:53827)
0808 05:56:34.270204 (+ 3710us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:34.270220 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:56:34.270494 (+ 274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:56:34.270967 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:56:34.270970 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:56:34.270987 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:56:34.271111 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.271117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.272186 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.272190 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.273778 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:56:34.273791 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.274865 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.274869 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:56:34.274969 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.274990 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 05:56:34.275473 (+ 483us) client_negotiation.cc:240] Negotiation successful
0808 05:56:34.275549 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3637,"thread_start_us":611,"threads_started":1}
I20260808 05:56:34.275769 15470 leader_election.cc:302] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66081947fb4743bcb5034a5f9470f2bd, 8673dafa11fa43998d4e68033351cbed; no voters:
I20260808 05:56:34.276360 15767 raft_consensus.cc:2781] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:56:34.276440 15767 raft_consensus.cc:482] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:56:34.276491 15767 raft_consensus.cc:3037] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:56:34.277329 15685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "371ca4f245d7430082cd2bd785a05d87" candidate_uuid: "8673dafa11fa43998d4e68033351cbed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2f64ae7693a4e3584781643e7fd7288" is_pre_election: true
I20260808 05:56:34.277624 15685 raft_consensus.cc:2454] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8673dafa11fa43998d4e68033351cbed in term 0.
I20260808 05:56:34.277872 15767 raft_consensus.cc:504] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.278235 15767 leader_election.cc:288] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [CANDIDATE]: Term 1 election: Requested vote from peers 66081947fb4743bcb5034a5f9470f2bd (127.2.191.65:39325), a2f64ae7693a4e3584781643e7fd7288 (127.2.191.67:43779)
I20260808 05:56:34.279373 15685 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "371ca4f245d7430082cd2bd785a05d87" candidate_uuid: "8673dafa11fa43998d4e68033351cbed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2f64ae7693a4e3584781643e7fd7288"
I20260808 05:56:34.279511 15685 raft_consensus.cc:3037] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:56:34.280107 15395 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "371ca4f245d7430082cd2bd785a05d87" candidate_uuid: "8673dafa11fa43998d4e68033351cbed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66081947fb4743bcb5034a5f9470f2bd"
I20260808 05:56:34.280232 15395 raft_consensus.cc:3037] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:56:34.281571 15395 raft_consensus.cc:2454] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8673dafa11fa43998d4e68033351cbed in term 1.
I20260808 05:56:34.281620 15685 raft_consensus.cc:2454] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8673dafa11fa43998d4e68033351cbed in term 1.
I20260808 05:56:34.282104 15469 leader_election.cc:302] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8673dafa11fa43998d4e68033351cbed, a2f64ae7693a4e3584781643e7fd7288; no voters:
I20260808 05:56:34.282487 15767 raft_consensus.cc:2781] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:56:34.282718 15767 raft_consensus.cc:686] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 1 LEADER]: Becoming Leader. State: Replica: 8673dafa11fa43998d4e68033351cbed, State: Running, Role: LEADER
I20260808 05:56:34.283067 15767 consensus_queue.cc:237] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } }
I20260808 05:56:34.286605 15216 catalog_manager.cc:5495] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed reported cstate change: term changed from 0 to 1, leader changed from <none> to 8673dafa11fa43998d4e68033351cbed (127.2.191.66). New cstate: current_term: 1 leader_uuid: "8673dafa11fa43998d4e68033351cbed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8673dafa11fa43998d4e68033351cbed" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 44835 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 } health_report { overall_health: UNKNOWN } } }
I20260808 05:56:34.315109 15755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.309811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46750 (local address 127.2.191.66:44835)
0808 05:56:34.309978 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 05:56:34.309984 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:56:34.310002 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:56:34.310111 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:56:34.310116 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:56:34.310202 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:56:34.310353 (+ 151us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:56:34.310644 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.311455 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.312813 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:56:34.313175 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:56:34.313277 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:56:34.313707 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:56:34.314294 (+ 587us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:56:34.314431 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 05:56:34.314883 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 05:56:34.314950 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 05:56:34.338969 15685 raft_consensus.cc:1261] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 1 FOLLOWER]: Refusing update from remote peer 8673dafa11fa43998d4e68033351cbed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:56:34.339762 15767 consensus_queue.cc:1035] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2f64ae7693a4e3584781643e7fd7288" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:56:34.347448 15395 raft_consensus.cc:1261] T 371ca4f245d7430082cd2bd785a05d87 P 66081947fb4743bcb5034a5f9470f2bd [term 1 FOLLOWER]: Refusing update from remote peer 8673dafa11fa43998d4e68033351cbed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:56:34.348342 15767 consensus_queue.cc:1035] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [LEADER]: Connected to new peer: Peer: permanent_uuid: "66081947fb4743bcb5034a5f9470f2bd" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:56:34.358234 15775 mvcc.cc:205] Tried to move back new op lower bound from 7316146562403520512 to 7316146562186924032. Current Snapshot: MvccSnapshot[applied={T|T < 7316146562403520512}]
I20260808 05:56:34.364818 15776 mvcc.cc:205] Tried to move back new op lower bound from 7316146562403520512 to 7316146562186924032. Current Snapshot: MvccSnapshot[applied={T|T < 7316146562403520512}]
I20260808 05:56:34.382392 15216 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:56:34.382612 15216 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36860:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:56:34.385901 15216 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c713209bbb924bba8a87659c94717fde: Sending DeleteTablet for 3 replicas of tablet 371ca4f245d7430082cd2bd785a05d87
I20260808 05:56:34.393170 15354 tablet_service.cc:1514] Processing DeleteTablet for tablet 371ca4f245d7430082cd2bd785a05d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:56:34 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:49510
I20260808 05:56:34.393797 15518 tablet_service.cc:1514] Processing DeleteTablet for tablet 371ca4f245d7430082cd2bd785a05d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:56:34 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:46744
I20260808 05:56:34.395826 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 15305
I20260808 05:56:34.400136 15786 tablet_replica.cc:330] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: stopping tablet replica
I20260808 05:56:34.402621 15786 raft_consensus.cc:2229] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:56:34.394397 15665 tablet_service.cc:1514] Processing DeleteTablet for tablet 371ca4f245d7430082cd2bd785a05d87 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:56:34 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:45282
I20260808 05:56:34.403168 15786 raft_consensus.cc:2258] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:56:34.406360 15786 ts_tablet_manager.cc:1905] T 371ca4f245d7430082cd2bd785a05d87 P 8673dafa11fa43998d4e68033351cbed: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 05:56:34.408885 15201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:39325 (error 108)
I20260808 05:56:34.410137 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 15452
I20260808 05:56:34.412196 15788 tablet_replica.cc:330] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: stopping tablet replica
I20260808 05:56:34.412640 15788 raft_consensus.cc:2229] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:56:34.413056 15788 raft_consensus.cc:2258] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:56:34.415619 15788 ts_tablet_manager.cc:1905] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:56:34.418569 15788 ts_tablet_manager.cc:1918] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:56:34.418797 15788 log.cc:1196] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/371ca4f245d7430082cd2bd785a05d87
I20260808 05:56:34.419395 15788 ts_tablet_manager.cc:1939] T 371ca4f245d7430082cd2bd785a05d87 P a2f64ae7693a4e3584781643e7fd7288: Deleting consensus metadata
I20260808 05:56:34.421741 15200 catalog_manager.cc:4841] TS a2f64ae7693a4e3584781643e7fd7288 (127.2.191.67:43779): tablet 371ca4f245d7430082cd2bd785a05d87 (table test-table [id=88ee5c8901e546b7a41abd0d430ba0d8]) successfully deleted
I20260808 05:56:34.426756 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 15597
I20260808 05:56:34.432415 15753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.431950 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39325 (local address 127.0.0.1:49512)
0808 05:56:34.432211 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:34.432306 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:39325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
W20260808 05:56:34.432644 15201 catalog_manager.cc:4584] TS 66081947fb4743bcb5034a5f9470f2bd (127.2.191.65:39325): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 371ca4f245d7430082cd2bd785a05d87: Network error: Client connection negotiation failed: client connection to 127.2.191.65:39325: connect: Connection refused (error 111)
I20260808 05:56:34.437984 15753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:56:34.437673 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:44835 (local address 127.0.0.1:46760)
0808 05:56:34.437812 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 05:56:34.437887 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.66:44835: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 05:56:34.448894 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 15183
I20260808 05:56:34.459177 2813 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 05:56:34.804229 2813 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 05:56:34.804379 2813 mini_ranger.cc:66] Stopping Ranger...
I20260808 05:56:35.149680 2813 mini_ranger.cc:68] Stopped Ranger
2026-08-08 05:56:35.150 UTC [14729] LOG: received smart shutdown request
2026-08-08 05:56:35.154 UTC [14729] LOG: background worker "logical replication launcher" (PID 14738) exited with exit code 1
2026-08-08 05:56:35.155 UTC [14733] LOG: shutting down
2026-08-08 05:56:35.342 UTC [14729] LOG: database system is shut down
2026-08-08T05:56:35Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (51308 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:56:35 dist-test-slave-qg60 krb5kdc[15799](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:56:35 dist-test-slave-qg60 krb5kdc[15799](info): set up 2 sockets
Aug 08 05:56:35 dist-test-slave-qg60 krb5kdc[15799](info): commencing operation
krb5kdc: starting...
W20260808 05:56:36.560806 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:56:36 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168596, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:56:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:56:36Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.2.191.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.2.191.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/rangeradmin_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/rangeradmin_127.2.191.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.2.191.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.2.191.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/rangerlookup_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/rangerlookup_127.2.191.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.2.191.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.2.191.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/HTTP_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/HTTP_127.2.191.84@KRBTEST.COM.keytab.
I20260808 05:56:36.748474 2813 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasklOEsuG/build/debug/bin/postgres/pg_ctl -D /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/postgres -l logfile start
2026-08-08 05:56:39.490 UTC [15831] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 05:56:39.490 UTC [15831] LOG: listening on IPv4 address "127.2.191.84", port 49897
2026-08-08 05:56:39.494 UTC [15831] LOG: listening on Unix socket "/tmp/.s.PGSQL.49897"
2026-08-08 05:56:39.530 UTC [15834] LOG: database system was shut down at 2026-08-08 05:56:37 UTC
2026-08-08 05:56:39.535 UTC [15831] LOG: database system is ready to accept connections
I20260808 05:56:40.530519 2813 mini_postgres.cc:96] Postgres bound to 49897
2026-08-08 05:56:40.538 UTC [15842] FATAL: database "slave" does not exist
127.2.191.84:49897 - accepting connections
I20260808 05:56:40.538825 2813 mini_ranger.cc:161] Starting Ranger...
I20260808 05:56:40.555335 2813 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 05:56:41.082132 2813 mini_ranger.cc:87] Created ranger Postgres database
I20260808 05:56:41.082227 2813 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-admin
2026-08-08 05:56:41,368 [I] DB FLAVOR :POSTGRES
2026-08-08 05:56:41,368 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:56:41,368 [I] Checking connection..
2026-08-08 05:56:41,368 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 05:56:41,632 [I] Checking connection passed.
2026-08-08 05:56:41,633 [I] --------- Verifying version history table ---------
2026-08-08 05:56:41,633 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:56:41,882 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:56:41,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:56:42,130 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:56:42,130 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 05:56:42,130 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 05:56:42.372 UTC [15911] WARNING: there is no transaction in progress
2026-08-08 05:56:42,379 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 05:56:42,379 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:56:42,638 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 05:56:42,638 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:56:42,638 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 05:56:42,911 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 05:56:43,180 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-qg60.c.gcp-upstream.internal','N') ;"
2026-08-08 05:56:43,429 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:56:43,694 [I] Table x_portal_user does not exist in database ranger
2026-08-08 05:56:43,694 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:56:43,963 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 05:56:43,963 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:56:44,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:56:44,511 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 05:56:44,511 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 05:56:45.544 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.563 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.581 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.599 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.620 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.638 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.696 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.705 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.721 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.733 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.746 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.761 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.771 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.779 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.786 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:45.793 UTC [16027] WARNING: there is no transaction in progress
2026-08-08 05:56:46,486 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 05:56:46,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 05:56:46,789 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 05:56:46,789 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:56:47,060 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 05:56:47,060 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:56:47,323 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 05:56:47,324 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:56:47,592 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:56:47,839 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-qg60.c.gcp-upstream.internal';"
2026-08-08 05:56:48,101 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 05:56:48,101 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 05:56:48,377 [I] DB_PATCHES have already been applied
I20260808 05:56:48.384344 2813 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-admin:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasklOEsuG/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 05:56:48.384423 2813 mini_ranger.cc:193] Using host: 127.2.191.84
I20260808 05:56:48.389109 2813 mini_ranger.cc:227] Ranger admin URL: http://127.2.191.84:56669
Aug 08, 2026 5:56:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:56:48 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:56:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:56:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:56:48 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:56:49 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:56:49 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 05:56:49.579800 2813 mini_ranger.cc:160] Time spent starting Ranger: real 9.041s user 0.000s sys 0.013s
Aug 08, 2026 5:57:09 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:57:09 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 5:57:09 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:57:09 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:57:10 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 05:57:10.998368 2813 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.2.191.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.2.191.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/rangerkms_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.2.191.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/rangerkms_127.2.191.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.2.191.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.2.191.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.2.191.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/HTTP_127.2.191.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.2.191.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/HTTP_127.2.191.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 05:57:11 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168631, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 05:57:11.110380 2813 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 05:57:11.121181 2813 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 05:57:12.093641 2813 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 05:57:12.093736 2813 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms
I20260808 05:57:12.093758 2813 mini_ranger_kms.cc:227] Using postgres at 127.2.191.84:49897
2026-08-08 05:57:12,317 [I] DB FLAVOR :POSTGRES
2026-08-08 05:57:12,317 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:57:12,317 [I] Checking connection
2026-08-08 05:57:12,318 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 05:57:12,573 [I] connection success
2026-08-08 05:57:12,573 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 05:57:12,573 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 05:57:12,573 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 05:57:12,824 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 05:57:12,824 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:57:12,825 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 05:57:12,825 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.2.191.84:49897/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 05:57:13,118 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 05:57:13.604365 2813 mini_ranger_kms.cc:310] Created kms service
I20260808 05:57:13.799222 2813 mini_ranger_kms.cc:326] Created kudu user
I20260808 05:57:13.847352 2813 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 05:57:13 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168631, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:14.288498 2813 mini_ranger_kms.cc:384] Added ranger policy
I20260808 05:57:14.288651 2813 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms:/tmp/dist-test-tasklOEsuG/build/debug/bin/postgresql.jar:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasklOEsuG/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 05:57:14.288674 2813 mini_ranger_kms.cc:240] Using host: 127.2.191.84
I20260808 05:57:14.293529 2813 mini_ranger_kms.cc:276] Ranger KMS PID: 16219
I20260808 05:57:14.293633 2813 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.2.191.84:40113
Aug 08, 2026 5:57:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:57:15 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:57:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:57:15 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:57:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:57:16 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260808 05:57:16.755393 2813 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.645s user 0.027s sys 0.182s
I20260808 05:57:16.755523 2813 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 05:57:16.755595 2813 mini_ranger_kms.cc:401] 127.2.191.84:40113/kms/v1/keys
Aug 08 05:57:16 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786168636, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.191.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 08 05:57:17 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168636, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.191.84@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
Aug 08 05:57:17 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168636, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.2.191.84@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
Aug 08 05:57:20 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:57:20.180104 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34511
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:34511
--ranger_config_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:40113/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:20.300673 16277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:20.301039 16277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:20.301084 16277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:20.305365 16277 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:20.305451 16277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:20.305471 16277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:20.305488 16277 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:20.305503 16277 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:20.311444 16277 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
--ranger_kms_url=127.2.191.84:40113/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:34511
--ranger_config_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:20.312671 16277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:20.313853 16277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:57:20.323072 16277 server_base.cc:1034] running on GCE node
W20260808 05:57:20.323109 16282 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:20.323108 16283 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:20.323511 16285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:20.324177 16277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:20.325662 16277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:20.326867 16277 hybrid_clock.cc:648] HybridClock initialized: now 1786168640326836 us; error 44 us; skew 500 ppm
Aug 08 05:57:20 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168640, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:20.335026 16277 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:57:20.336061 16277 webserver.cc:460] Webserver started at http://127.2.191.126:37475/ using document root <none> and password file <none>
I20260808 05:57:20.336663 16277 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:20.336776 16277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:20.337029 16277 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:57:20 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168640, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:20.386498 16277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "9c185e458a784fc49e6b86cc1a70299f"
format_stamp: "Formatted at 2026-08-08 05:57:20 on dist-test-slave-qg60"
server_key: "95a0663b84d6d1f2c77560e06a2c6291"
server_key_iv: "175c22d0405aa3cc59c21bdb37ea9ea6"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:20.387172 16277 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "9c185e458a784fc49e6b86cc1a70299f"
format_stamp: "Formatted at 2026-08-08 05:57:20 on dist-test-slave-qg60"
server_key: "95a0663b84d6d1f2c77560e06a2c6291"
server_key_iv: "175c22d0405aa3cc59c21bdb37ea9ea6"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:20.391753 16277 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 05:57:20.408533 16293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:20.410076 16277 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:57:20.410203 16277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "9c185e458a784fc49e6b86cc1a70299f"
format_stamp: "Formatted at 2026-08-08 05:57:20 on dist-test-slave-qg60"
server_key: "95a0663b84d6d1f2c77560e06a2c6291"
server_key_iv: "175c22d0405aa3cc59c21bdb37ea9ea6"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:20.410385 16277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:20.424223 16277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:20.427572 16277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:20.427790 16277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:20.435871 16277 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:34511
I20260808 05:57:20.435887 16349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:34511 every 8 connection(s)
I20260808 05:57:20.436976 16277 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:57:20.439147 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 16277
I20260808 05:57:20.439301 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:57:20.439617 2813 external_mini_cluster.cc:1428] Setting key bf8a4c11aefcfbd8ed5f4aca400648bb
I20260808 05:57:20.440354 16350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:20.448136 16350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Bootstrap starting.
Aug 08 05:57:20 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:20.450901 16350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:20.451735 16350 log.cc:824] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:20.454149 16350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: No bootstrap required, opened a new log
I20260808 05:57:20.457031 16353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:20.441125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51716 (local address 127.2.191.126:34511)
0808 05:57:20.441562 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:20.441579 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:20.441617 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:57:20.442276 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:20.442292 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:20.442625 (+ 333us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:20.442907 (+ 282us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:20.444072 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:20.445149 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:20.446515 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:20.446983 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:20.447109 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:20.450509 (+ 3400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:20.450515 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:20.450530 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:20.450559 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:20.453354 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:20.453895 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:20.453902 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:20.453917 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:20.454033 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:20.454398 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:20.454402 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:20.454404 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:20.455041 (+ 637us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:20.455261 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:20.455570 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 05:57:20.455890 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":287,"thread_start_us":153,"threads_started":1}
I20260808 05:57:20.458384 16350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } }
I20260808 05:57:20.458640 16350 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:20.458745 16350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c185e458a784fc49e6b86cc1a70299f, State: Initialized, Role: FOLLOWER
I20260808 05:57:20.459198 16350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } }
I20260808 05:57:20.459331 16350 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:57:20.459429 16350 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:57:20.459540 16350 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:20.460621 16350 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } }
I20260808 05:57:20.461031 16350 leader_election.cc:302] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c185e458a784fc49e6b86cc1a70299f; no voters:
I20260808 05:57:20.461387 16350 leader_election.cc:288] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:57:20.461548 16355 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:20.461813 16355 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 1 LEADER]: Becoming Leader. State: Replica: 9c185e458a784fc49e6b86cc1a70299f, State: Running, Role: LEADER
I20260808 05:57:20.462167 16355 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } }
I20260808 05:57:20.462769 16350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:20.464138 16358 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c185e458a784fc49e6b86cc1a70299f. Latest consensus state: current_term: 1 leader_uuid: "9c185e458a784fc49e6b86cc1a70299f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } } }
I20260808 05:57:20.464143 16356 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c185e458a784fc49e6b86cc1a70299f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } } }
I20260808 05:57:20.464306 16356 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:20.464308 16358 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:20.465294 16365 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:57:20.465679 16350 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 05:57:20.472517 16365 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:57:20.482110 16365 catalog_manager.cc:1347] Generated new cluster ID: a048b629113844efb178068ba66a7d17
I20260808 05:57:20.482251 16365 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:57:20.505172 16365 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:57:20.506860 16365 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:57:20.522643 16365 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Generated new TSK 0
I20260808 05:57:20.523509 16365 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:57:21.296351 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:40113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34511
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:21.475050 16399 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:21.475428 16399 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:21.475567 16399 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:21.480067 16399 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:21.480176 16399 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:21.480278 16399 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:57:21.486090 16399 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.2.191.84:40113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16399
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:21.487749 16399 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:21.489202 16399 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:21.502332 16411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:21.502333 16409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:21.502590 16399 server_base.cc:1034] running on GCE node
W20260808 05:57:21.502880 16408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:21.503361 16399 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:21.504210 16399 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:21.505419 16399 hybrid_clock.cc:648] HybridClock initialized: now 1786168641505384 us; error 53 us; skew 500 ppm
Aug 08 05:57:21 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168641, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:21.509367 16399 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:57:21.510732 16399 webserver.cc:460] Webserver started at http://127.2.191.65:46225/ using document root <none> and password file <none>
I20260808 05:57:21.511535 16399 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:21.511644 16399 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:21.511993 16399 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:57:21 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168641, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:21.531641 16399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "3fc3c682fa0a447198d23d6d15e641e2"
format_stamp: "Formatted at 2026-08-08 05:57:21 on dist-test-slave-qg60"
server_key: "2f3b95605762cecb4c0989ee4328bea3"
server_key_iv: "a2994981af33da31e1aa0958a18adbad"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:21.532651 16399 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "3fc3c682fa0a447198d23d6d15e641e2"
format_stamp: "Formatted at 2026-08-08 05:57:21 on dist-test-slave-qg60"
server_key: "2f3b95605762cecb4c0989ee4328bea3"
server_key_iv: "a2994981af33da31e1aa0958a18adbad"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:21.542320 16399 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.000s sys 0.004s
I20260808 05:57:21.559341 16418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:21.561206 16399 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:57:21.561352 16399 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "3fc3c682fa0a447198d23d6d15e641e2"
format_stamp: "Formatted at 2026-08-08 05:57:21 on dist-test-slave-qg60"
server_key: "2f3b95605762cecb4c0989ee4328bea3"
server_key_iv: "a2994981af33da31e1aa0958a18adbad"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:21.561498 16399 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:21.585116 16399 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:21.589000 16399 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:21.589263 16399 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:21.590005 16399 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:21.591238 16399 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:21.591368 16399 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260808 05:57:21.591499 16399 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:21.591583 16399 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:21.602620 16399 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:36929
I20260808 05:57:21.603969 16399 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:57:21.606762 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 16399
I20260808 05:57:21.606895 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:57:21.607208 2813 external_mini_cluster.cc:1428] Setting key 0511bf4a7d48e4e16623a3c469029489
I20260808 05:57:21.618875 16542 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:36929 every 8 connection(s)
Aug 08 05:57:21 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168641, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:21.625715 16546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:21.608773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:52033 (local address 127.2.191.126:34511)
0808 05:57:21.610857 (+ 2084us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:21.610862 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:21.610877 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:57:21.610919 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:21.610922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:21.610971 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:21.611082 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:21.612778 (+ 1696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:21.613664 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:21.617038 (+ 3374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:21.617413 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:21.617501 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:21.620886 (+ 3385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:21.620890 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:21.620893 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:21.620923 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:21.622914 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:21.623637 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:21.623641 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:21.623643 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:21.623746 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:21.624237 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:21.624243 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:21.624247 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:21.624510 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:21.624613 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:21.625376 (+ 763us) server_negotiation.cc:299] Negotiation successful
0808 05:57:21.625520 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2000,"thread_start_us":91,"threads_started":1}
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:57:21.627122 16545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:21.607595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34511 (local address 127.2.191.65:52033)
0808 05:57:21.609264 (+ 1669us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:21.609327 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:21.610414 (+ 1087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:21.611404 (+ 990us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:21.611414 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:21.611783 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:21.612546 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:21.612567 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:21.615179 (+ 2612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:21.615183 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:21.616588 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:21.616599 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:21.617764 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:21.617768 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:21.617974 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:21.618733 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:21.618756 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:21.620636 (+ 1880us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:21.623086 (+ 2450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:21.623096 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:21.623116 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:21.623496 (+ 380us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:21.623876 (+ 380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:21.623880 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:21.623882 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:21.624103 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:21.624679 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:21.624688 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:21.625106 (+ 418us) client_negotiation.cc:769] Sending connection context
0808 05:57:21.625315 (+ 209us) client_negotiation.cc:240] Negotiation successful
0808 05:57:21.625639 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1424,"thread_start_us":144,"threads_started":1}
I20260808 05:57:21.629014 16543 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34511
I20260808 05:57:21.629271 16543 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:21.629855 16543 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
I20260808 05:57:21.631650 16311 ts_manager.cc:194] Registered new tserver with Master: 3fc3c682fa0a447198d23d6d15e641e2 (127.2.191.65:36929)
I20260808 05:57:21.633282 16311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:52033
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:57:21.673358 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:40113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34511
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:57:21 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786168641, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 05:57:21.840277 16551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:21.840760 16551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:21.840857 16551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:21.847108 16551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:21.847199 16551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:21.847296 16551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:57:21.855587 16551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.2.191.84:40113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:21.857138 16551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:21.858584 16551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:21.876278 16561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:21.876377 16563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:21.876300 16560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:21.877770 16551 server_base.cc:1034] running on GCE node
I20260808 05:57:21.878273 16551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:21.879124 16551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:21.880332 16551 hybrid_clock.cc:648] HybridClock initialized: now 1786168641880265 us; error 79 us; skew 500 ppm
Aug 08 05:57:21 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168641, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:21.884524 16551 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:57:21.885717 16551 webserver.cc:460] Webserver started at http://127.2.191.66:44725/ using document root <none> and password file <none>
I20260808 05:57:21.886445 16551 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:21.886535 16551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:21.886786 16551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:57:21 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168641, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:21.904289 16551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "9e3901e2dab342c39d972282b75e5ec3"
format_stamp: "Formatted at 2026-08-08 05:57:21 on dist-test-slave-qg60"
server_key: "2814d8c6dd45648cca792e686eed5364"
server_key_iv: "c687881ff99f80b9020ac9b1eac42ffa"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:21.905207 16551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "9e3901e2dab342c39d972282b75e5ec3"
format_stamp: "Formatted at 2026-08-08 05:57:21 on dist-test-slave-qg60"
server_key: "2814d8c6dd45648cca792e686eed5364"
server_key_iv: "c687881ff99f80b9020ac9b1eac42ffa"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:21.912833 16551 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260808 05:57:21.931150 16570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:21.933005 16551 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:57:21.933142 16551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "9e3901e2dab342c39d972282b75e5ec3"
format_stamp: "Formatted at 2026-08-08 05:57:21 on dist-test-slave-qg60"
server_key: "2814d8c6dd45648cca792e686eed5364"
server_key_iv: "c687881ff99f80b9020ac9b1eac42ffa"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:21.933288 16551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:21.960637 16551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:21.964673 16551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:21.964964 16551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:21.965950 16551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:21.967655 16551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:21.967778 16551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:21.967896 16551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:21.967970 16551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:21.986299 16551 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:42169
I20260808 05:57:21.986410 16696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:42169 every 8 connection(s)
I20260808 05:57:21.987563 16551 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:57:21.998142 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 16551
I20260808 05:57:21.998324 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:57:21.998728 2813 external_mini_cluster.cc:1428] Setting key 023ef2ecf76f4ea6e053044244c7794e
Aug 08 05:57:21 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168641, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:22.009157 16699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:21.991295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34511 (local address 127.2.191.66:52247)
0808 05:57:21.991851 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:21.991914 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:21.993263 (+ 1349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:21.993988 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:21.994000 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:21.994543 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:21.995353 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:21.995376 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:21.996559 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:21.996563 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:21.997993 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:21.998005 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:21.998808 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:21.998811 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:21.999075 (+ 264us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:22.000193 (+ 1118us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:22.000211 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:22.002437 (+ 2226us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:22.004932 (+ 2495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:22.004939 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:22.004957 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:22.005345 (+ 388us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:22.005784 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:22.005789 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:22.005792 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:22.006062 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:22.006780 (+ 718us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:22.006788 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:22.007179 (+ 391us) client_negotiation.cc:769] Sending connection context
0808 05:57:22.007429 (+ 250us) client_negotiation.cc:240] Negotiation successful
0808 05:57:22.007855 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"thread_start_us":127,"threads_started":1}
I20260808 05:57:22.009910 16546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:21.990866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:52247 (local address 127.2.191.126:34511)
0808 05:57:21.991038 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:21.991046 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:21.992051 (+ 1005us) server_negotiation.cc:407] Connection header received
0808 05:57:21.993562 (+ 1511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:21.993566 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:21.993634 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:21.993725 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:21.995546 (+ 1821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:21.996398 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:21.998140 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:21.998508 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:21.998583 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:22.002757 (+ 4174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:22.002762 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:22.002765 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:22.002798 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:22.004784 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:22.005508 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:22.005512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:22.005514 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:22.005648 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:22.006233 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:22.006237 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:22.006239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:22.006558 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:22.006706 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:22.009670 (+ 2964us) server_negotiation.cc:299] Negotiation successful
0808 05:57:22.009798 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:57:22.010910 16697 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34511
I20260808 05:57:22.011184 16697 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:22.011723 16697 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
I20260808 05:57:22.012915 16311 ts_manager.cc:194] Registered new tserver with Master: 9e3901e2dab342c39d972282b75e5ec3 (127.2.191.66:42169)
I20260808 05:57:22.013506 16311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:52247
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:57:22.037943 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:40113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34511
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:22.259620 16702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:22.260097 16702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:22.260219 16702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:22.266573 16702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:22.266716 16702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:22.266847 16702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:57:22.275410 16702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.2.191.84:40113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:22.277070 16702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:22.278478 16702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 08 05:57:22 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168641, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
W20260808 05:57:22.297137 16710 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:22.301128 16712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:22.302033 16702 server_base.cc:1034] running on GCE node
W20260808 05:57:22.304943 16709 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:22.305650 16702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:22.306553 16702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:22.313951 16702 hybrid_clock.cc:648] HybridClock initialized: now 1786168642313772 us; error 185 us; skew 500 ppm
Aug 08 05:57:22 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168642, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:22.318362 16702 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:57:22.319733 16702 webserver.cc:460] Webserver started at http://127.2.191.67:40777/ using document root <none> and password file <none>
I20260808 05:57:22.320560 16702 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:22.320757 16702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:22.321071 16702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:57:22 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168642, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:22.369823 16702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "fdfc6f7088d648af81021da9f7d8910e"
format_stamp: "Formatted at 2026-08-08 05:57:22 on dist-test-slave-qg60"
server_key: "2124c19c2cf9a96596ce07ee8221f676"
server_key_iv: "27fac886a8aac0acac2cc1e3bdd2c485"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:22.377637 16702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "fdfc6f7088d648af81021da9f7d8910e"
format_stamp: "Formatted at 2026-08-08 05:57:22 on dist-test-slave-qg60"
server_key: "2124c19c2cf9a96596ce07ee8221f676"
server_key_iv: "27fac886a8aac0acac2cc1e3bdd2c485"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:22.394429 16702 fs_manager.cc:691] Time spent creating directory manager: real 0.016s user 0.005s sys 0.000s
I20260808 05:57:22.412247 16719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:22.414075 16702 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260808 05:57:22.414243 16702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "fdfc6f7088d648af81021da9f7d8910e"
format_stamp: "Formatted at 2026-08-08 05:57:22 on dist-test-slave-qg60"
server_key: "2124c19c2cf9a96596ce07ee8221f676"
server_key_iv: "27fac886a8aac0acac2cc1e3bdd2c485"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:22.414391 16702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:22.442216 16702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:22.446372 16702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:22.446668 16702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:22.447562 16702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:22.448793 16702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:22.448905 16702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:22.449033 16702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:22.449102 16702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:22.469460 16702 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:34643
I20260808 05:57:22.470927 16702 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:57:22.472060 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 16702
I20260808 05:57:22.472191 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:57:22.472607 2813 external_mini_cluster.cc:1428] Setting key 0b0eebb606d3834fbce42dc4a80bdc5c
I20260808 05:57:22.474677 16843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:34643 every 8 connection(s)
Aug 08 05:57:22 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168642, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:22.495393 16546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:22.476586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:49719 (local address 127.2.191.126:34511)
0808 05:57:22.476718 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:22.476744 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:22.478764 (+ 2020us) server_negotiation.cc:407] Connection header received
0808 05:57:22.480175 (+ 1411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:22.480179 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:22.480242 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:22.480298 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:22.482047 (+ 1749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:22.482882 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:22.484686 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:22.485056 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:22.485138 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:22.490393 (+ 5255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:22.490397 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:22.490400 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:22.490432 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:22.492360 (+ 1928us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:22.493256 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:22.493259 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:22.493261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:22.493359 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:22.493792 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:22.493795 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:22.493797 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:22.494027 (+ 230us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:22.494113 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:22.495059 (+ 946us) server_negotiation.cc:299] Negotiation successful
0808 05:57:22.495210 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:57:22.496577 16846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:22.477224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34511 (local address 127.2.191.67:49719)
0808 05:57:22.478596 (+ 1372us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:22.478659 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:22.479901 (+ 1242us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:22.480764 (+ 863us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:22.480777 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:22.481153 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:22.481864 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:22.481883 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:22.483051 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:22.483054 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:22.484530 (+ 1476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:22.484542 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:22.485356 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:22.485360 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:22.487386 (+ 2026us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:22.488155 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:22.488180 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:22.490171 (+ 1991us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:22.492542 (+ 2371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:22.492549 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:22.492670 (+ 121us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:22.493110 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:22.493475 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:22.493478 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:22.493480 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:22.493680 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:22.494185 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:22.494192 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:22.494721 (+ 529us) client_negotiation.cc:769] Sending connection context
0808 05:57:22.494949 (+ 228us) client_negotiation.cc:240] Negotiation successful
0808 05:57:22.495312 (+ 363us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1125,"thread_start_us":217,"threads_started":1}
I20260808 05:57:22.497978 16844 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34511
I20260808 05:57:22.498239 16844 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:22.498799 16844 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
I20260808 05:57:22.500128 16311 ts_manager.cc:194] Registered new tserver with Master: fdfc6f7088d648af81021da9f7d8910e (127.2.191.67:34643)
I20260808 05:57:22.500952 16311 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:49719
I20260808 05:57:22.511289 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:57:22.512270 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 16399
I20260808 05:57:22.523176 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 16551
I20260808 05:57:22.532590 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 16702
I20260808 05:57:22.543884 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 16277
I20260808 05:57:22.552484 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34511
--webserver_interface=127.2.191.126
--webserver_port=37475
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:34511
--ranger_config_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:40113/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.2.191.84:40113/kms with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:22.667848 16847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:22.668149 16847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:22.668190 16847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:22.672655 16847 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:22.672719 16847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:22.672789 16847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:22.672825 16847 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:22.672860 16847 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:22.678648 16847 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.2.191.84:40113/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:34511
--ranger_config_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=37475
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:22.679793 16847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:22.680866 16847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:22.689632 16853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:22.689657 16855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:22.689642 16852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:22.690104 16847 server_base.cc:1034] running on GCE node
I20260808 05:57:22.690665 16847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:22.691807 16847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:22.692965 16847 hybrid_clock.cc:648] HybridClock initialized: now 1786168642692948 us; error 32 us; skew 500 ppm
Aug 08 05:57:22 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168642, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:22.695885 16847 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:57:22.696884 16847 webserver.cc:460] Webserver started at http://127.2.191.126:37475/ using document root <none> and password file <none>
I20260808 05:57:22.697443 16847 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:22.697546 16847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:57:22 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168642, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:22.746932 16847 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.002s sys 0.002s
I20260808 05:57:22.749912 16863 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:22.751358 16847 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:57:22.751497 16847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "9c185e458a784fc49e6b86cc1a70299f"
format_stamp: "Formatted at 2026-08-08 05:57:20 on dist-test-slave-qg60"
server_key: "95a0663b84d6d1f2c77560e06a2c6291"
server_key_iv: "175c22d0405aa3cc59c21bdb37ea9ea6"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:22.752100 16847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:22.777096 16847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:22.780041 16847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:22.780282 16847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:22.788045 16847 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:34511
I20260808 05:57:22.788065 16916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:34511 every 8 connection(s)
I20260808 05:57:22.789284 16847 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:57:22.791105 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 16847
I20260808 05:57:22.791579 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:40113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:36929
--local_ip_for_outbound_sockets=127.2.191.65
--tserver_master_addrs=127.2.191.126:34511
--webserver_port=46225
--webserver_interface=127.2.191.65
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.2.191.84:40113/kms with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:22.794060 16917 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:57:22.795966 16917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Bootstrap starting.
I20260808 05:57:22.813608 16917 log.cc:824] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:22.820636 16917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:57:22.821132 16917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Bootstrap complete.
I20260808 05:57:22.825525 16917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } }
I20260808 05:57:22.825960 16917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c185e458a784fc49e6b86cc1a70299f, State: Initialized, Role: FOLLOWER
I20260808 05:57:22.826561 16917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } }
I20260808 05:57:22.826686 16917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:57:22.826776 16917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:57:22.826871 16917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:57:22.828878 16917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } }
I20260808 05:57:22.829250 16917 leader_election.cc:302] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c185e458a784fc49e6b86cc1a70299f; no voters:
I20260808 05:57:22.829608 16917 leader_election.cc:288] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:57:22.829739 16922 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:57:22.830031 16922 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [term 2 LEADER]: Becoming Leader. State: Replica: 9c185e458a784fc49e6b86cc1a70299f, State: Running, Role: LEADER
I20260808 05:57:22.830360 16922 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } }
I20260808 05:57:22.831233 16917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:22.831957 16924 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c185e458a784fc49e6b86cc1a70299f. Latest consensus state: current_term: 2 leader_uuid: "9c185e458a784fc49e6b86cc1a70299f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } } }
I20260808 05:57:22.831960 16923 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9c185e458a784fc49e6b86cc1a70299f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c185e458a784fc49e6b86cc1a70299f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34511 } } }
I20260808 05:57:22.832108 16924 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:22.832124 16923 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:22.832486 16929 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:57:22.835736 16929 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:57:22.836313 16917 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 05:57:22.836441 16929 catalog_manager.cc:1259] Loaded cluster ID: a048b629113844efb178068ba66a7d17
I20260808 05:57:22.836490 16929 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:57:22.839164 16929 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:57:22.839915 16929 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Loaded TSK: 0
I20260808 05:57:22.841188 16929 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:57:22.924768 16920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:22.925141 16920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:22.925233 16920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:22.929764 16920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:22.929847 16920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:22.929952 16920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:57:22.936205 16920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.2.191.84:40113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:36929
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=46225
--tserver_master_addrs=127.2.191.126:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:22.937675 16920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:22.938984 16920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:22.950549 16961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:22.950711 16958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:22.951102 16959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:22.952486 16920 server_base.cc:1034] running on GCE node
I20260808 05:57:22.953020 16920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:22.953869 16920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:22.955075 16920 hybrid_clock.cc:648] HybridClock initialized: now 1786168642955051 us; error 39 us; skew 500 ppm
Aug 08 05:57:22 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168642, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:22.958705 16920 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:57:22.959802 16920 webserver.cc:460] Webserver started at http://127.2.191.65:46225/ using document root <none> and password file <none>
I20260808 05:57:22.960500 16920 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:22.960600 16920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:57:22 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168642, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:22.986992 16920 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:57:22.993762 16970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:22.995599 16920 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.004s sys 0.000s
I20260808 05:57:22.995759 16920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "3fc3c682fa0a447198d23d6d15e641e2"
format_stamp: "Formatted at 2026-08-08 05:57:21 on dist-test-slave-qg60"
server_key: "2f3b95605762cecb4c0989ee4328bea3"
server_key_iv: "a2994981af33da31e1aa0958a18adbad"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:22.996565 16920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:23.011998 16920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:23.016920 16920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:23.017153 16920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:23.017940 16920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:23.019059 16920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:23.019125 16920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:23.019181 16920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:23.019212 16920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:23.030102 16920 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:36929
I20260808 05:57:23.031646 16920 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:57:23.033452 17095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:36929 every 8 connection(s)
I20260808 05:57:23.041739 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 16920
I20260808 05:57:23.042323 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:40113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:42169
--local_ip_for_outbound_sockets=127.2.191.66
--tserver_master_addrs=127.2.191.126:34511
--webserver_port=44725
--webserver_interface=127.2.191.66
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.2.191.84:40113/kms with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:57:23 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168642, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:23.064134 17100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:23.036526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34511 (local address 127.2.191.65:50401)
0808 05:57:23.037352 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:23.037410 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:23.038290 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:23.039487 (+ 1197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:23.039496 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:23.039865 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:23.040339 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:23.040368 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.041994 (+ 1626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.041998 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:23.043520 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:23.043537 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.044862 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.044867 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:23.045059 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:23.045797 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:23.045818 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:23.056465 (+ 10647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:23.059973 (+ 3508us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:23.059980 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:23.059997 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:23.060404 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:23.060963 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:23.060967 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:23.060969 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:23.061171 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:23.062005 (+ 834us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:23.062013 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:23.062349 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 05:57:23.062556 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 05:57:23.062949 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":626,"thread_start_us":169,"threads_started":1}
I20260808 05:57:23.066424 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:23.036359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:50401 (local address 127.2.191.126:34511)
0808 05:57:23.037055 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:23.037079 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:23.037539 (+ 460us) server_negotiation.cc:407] Connection header received
0808 05:57:23.038735 (+ 1196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:23.038746 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:23.039062 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:23.039406 (+ 344us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:23.040561 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.041813 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.043700 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.044501 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.044694 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:23.056827 (+ 12133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:23.056836 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:23.056856 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:23.056896 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:23.059755 (+ 2859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:23.060599 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:23.060607 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:23.060612 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:23.060803 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:23.061314 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:23.061317 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:23.061319 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:23.061840 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:23.064934 (+ 3094us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:23.065125 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 05:57:23.065478 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":129,"threads_started":1}
I20260808 05:57:23.069268 17097 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34511
I20260808 05:57:23.069563 17097 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:23.070230 17097 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
W20260808 05:57:23.072999 17097 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:34511 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 05:57:23.073154 17097 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:23.073390 17097 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
I20260808 05:57:23.074363 17097 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:23.074579 17097 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
W20260808 05:57:23.075403 17097 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:57:23.205435 17101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:23.205827 17101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:23.205894 17101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:23.212057 17101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:23.212153 17101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:23.212245 17101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:57:23.218943 17101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.2.191.84:40113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:42169
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=44725
--tserver_master_addrs=127.2.191.126:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:23.220273 17101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:23.221554 17101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:23.234709 17106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:23.234710 17107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:23.235348 17109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:23.235719 17101 server_base.cc:1034] running on GCE node
I20260808 05:57:23.236265 17101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:23.237017 17101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:23.238211 17101 hybrid_clock.cc:648] HybridClock initialized: now 1786168643238179 us; error 52 us; skew 500 ppm
Aug 08 05:57:23 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168643, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:23.241475 17101 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:57:23.242452 17101 webserver.cc:460] Webserver started at http://127.2.191.66:44725/ using document root <none> and password file <none>
I20260808 05:57:23.243045 17101 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:23.243120 17101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:57:23 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168643, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:23.266585 17101 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:57:23.270095 17118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:23.274009 17101 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.004s sys 0.000s
I20260808 05:57:23.274247 17101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "9e3901e2dab342c39d972282b75e5ec3"
format_stamp: "Formatted at 2026-08-08 05:57:21 on dist-test-slave-qg60"
server_key: "2814d8c6dd45648cca792e686eed5364"
server_key_iv: "c687881ff99f80b9020ac9b1eac42ffa"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:23.275127 17101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:23.301384 17101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:23.305653 17101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:23.306037 17101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:23.306902 17101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:23.308007 17101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:23.308118 17101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:23.308210 17101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:23.308261 17101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:23.319672 17101 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:42169
I20260808 05:57:23.321316 17101 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:57:23.321419 17241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:42169 every 8 connection(s)
I20260808 05:57:23.327414 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 17101
I20260808 05:57:23.327970 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.2.191.84:40113/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:34643
--local_ip_for_outbound_sockets=127.2.191.67
--tserver_master_addrs=127.2.191.126:34511
--webserver_port=40777
--webserver_interface=127.2.191.67
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34807
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.2.191.84:40113/kms with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:57:23 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168643, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:23.344430 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:23.323763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:44285 (local address 127.2.191.126:34511)
0808 05:57:23.323941 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:23.323954 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:23.324946 (+ 992us) server_negotiation.cc:407] Connection header received
0808 05:57:23.326105 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:23.326109 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:23.326167 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:23.326226 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:23.328164 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.329137 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.330916 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.331273 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.331359 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:23.339426 (+ 8067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:23.339431 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:23.339433 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:23.339486 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:23.341453 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:23.342220 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:23.342223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:23.342225 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:23.342328 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:23.342920 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:23.342924 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:23.342926 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:23.343179 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:23.343258 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:23.344062 (+ 804us) server_negotiation.cc:299] Negotiation successful
0808 05:57:23.344228 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 05:57:23.346809 17244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:23.324213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34511 (local address 127.2.191.66:44285)
0808 05:57:23.324715 (+ 502us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:23.324823 (+ 108us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:23.325818 (+ 995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:23.326664 (+ 846us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:23.326674 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:23.327151 (+ 477us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:23.327962 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:23.327985 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.329321 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.329327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:23.330764 (+ 1437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:23.330775 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.331590 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.331595 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:23.331791 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:23.337193 (+ 5402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:23.337218 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:23.339157 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:23.341646 (+ 2489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:23.341652 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:23.341672 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:23.342074 (+ 402us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:23.342464 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:23.342468 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:23.342470 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:23.342784 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:23.343348 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:23.343354 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:23.343742 (+ 388us) client_negotiation.cc:769] Sending connection context
0808 05:57:23.345215 (+ 1473us) client_negotiation.cc:240] Negotiation successful
0808 05:57:23.345637 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":155,"threads_started":1}
I20260808 05:57:23.348644 17242 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34511
I20260808 05:57:23.348959 17242 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:23.349705 17242 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
W20260808 05:57:23.351747 17242 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:34511 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 05:57:23.351893 17242 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:23.352106 17242 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
I20260808 05:57:23.353206 17242 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:23.353410 17242 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
W20260808 05:57:23.354341 17242 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:57:23.495273 17245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:23.495646 17245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:23.495723 17245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:23.502199 17245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:23.502292 17245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:23.502391 17245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:57:23.510607 17245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34807
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.2.191.84:40113/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:34643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=40777
--tserver_master_addrs=127.2.191.126:34511
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:23.512302 17245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:23.513900 17245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:23.529338 17254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:23.529543 17256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:23.529724 17253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:23.530624 17245 server_base.cc:1034] running on GCE node
I20260808 05:57:23.531364 17245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:23.532570 17245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:23.535938 17245 hybrid_clock.cc:648] HybridClock initialized: now 1786168643535876 us; error 84 us; skew 500 ppm
Aug 08 05:57:23 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168643, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:23.540343 17245 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:57:23.541673 17245 webserver.cc:460] Webserver started at http://127.2.191.67:40777/ using document root <none> and password file <none>
I20260808 05:57:23.542472 17245 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:23.542603 17245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:57:23 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168643, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:23.573732 17245 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:57:23.577085 17265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:23.578730 17245 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:57:23.578922 17245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "fdfc6f7088d648af81021da9f7d8910e"
format_stamp: "Formatted at 2026-08-08 05:57:22 on dist-test-slave-qg60"
server_key: "2124c19c2cf9a96596ce07ee8221f676"
server_key_iv: "27fac886a8aac0acac2cc1e3bdd2c485"
server_key_version: "kuduclusterkey@0"
I20260808 05:57:23.579746 17245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:23.641186 17245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:23.644660 17245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:23.644938 17245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:23.645654 17245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:23.646570 17245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:23.646644 17245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:23.646719 17245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:23.646739 17245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:23.656189 17245 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:34643
I20260808 05:57:23.657232 17385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:34643 every 8 connection(s)
I20260808 05:57:23.657442 17245 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:57:23.660562 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 17245
Aug 08 05:57:23 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168643, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:23.673836 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:23.661181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:49871 (local address 127.2.191.126:34511)
0808 05:57:23.661691 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:23.661696 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:23.661717 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:57:23.661932 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:23.661936 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:23.661993 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:23.662099 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:23.663590 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.664356 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.666208 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.666437 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.666558 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:23.669243 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:23.669248 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:23.669254 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:23.669285 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:23.671091 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:23.671747 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:23.671752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:23.671754 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:23.671856 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:23.672368 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:23.672373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:23.672375 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:23.672616 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:23.672715 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:23.673495 (+ 780us) server_negotiation.cc:299] Negotiation successful
0808 05:57:23.673635 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417}
I20260808 05:57:23.675552 17389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:23.661309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.2.191.126:34511)
0808 05:57:23.662242 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:23.662246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:23.662258 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:57:23.662296 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:23.662300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:23.662341 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:23.662432 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:23.663414 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.664229 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.668821 (+ 4592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.669200 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.669288 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:23.671090 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:23.671094 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:23.671097 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:23.671123 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:23.672910 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:23.673415 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:23.673421 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:23.673427 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:23.673524 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:23.673861 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:23.673864 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:23.673866 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:23.674173 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:23.674369 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:23.675158 (+ 789us) server_negotiation.cc:299] Negotiation successful
0808 05:57:23.675304 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":870,"thread_start_us":110,"threads_started":1}
I20260808 05:57:23.675880 17388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:23.660017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34511 (local address 127.2.191.67:49871)
0808 05:57:23.660551 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:23.660611 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:23.661711 (+ 1100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:23.662280 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:23.662287 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:23.662661 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:23.663407 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:23.663425 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.664531 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.664535 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:23.666027 (+ 1492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:23.666042 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:23.666607 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:23.666611 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:23.666792 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:23.667467 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:23.667487 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:23.669038 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:23.671214 (+ 2176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:23.671222 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:23.671243 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:23.671616 (+ 373us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:23.672001 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:23.672004 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:23.672006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:23.672235 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:23.672827 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:23.672837 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:23.673209 (+ 372us) client_negotiation.cc:769] Sending connection context
0808 05:57:23.674406 (+ 1197us) client_negotiation.cc:240] Negotiation successful
0808 05:57:23.674786 (+ 380us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":165,"threads_started":1}
I20260808 05:57:23.677785 17386 heartbeater.cc:347] Connected to a master server at 127.2.191.126:34511
I20260808 05:57:23.678048 17386 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:23.678658 17386 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
I20260808 05:57:23.680130 16880 ts_manager.cc:194] Registered new tserver with Master: fdfc6f7088d648af81021da9f7d8910e (127.2.191.67:34643)
I20260808 05:57:23.681802 16880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:49871
Aug 08 05:57:24 dist-test-slave-qg60 krb5kdc[15799](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786168644, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:24.075668 17097 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:24.076017 17097 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
I20260808 05:57:24.076941 16880 ts_manager.cc:194] Registered new tserver with Master: 3fc3c682fa0a447198d23d6d15e641e2 (127.2.191.65:36929)
I20260808 05:57:24.077788 16880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:50401
I20260808 05:57:24.354615 17242 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:24.354947 17242 heartbeater.cc:511] Master 127.2.191.126:34511 requested a full tablet report, sending...
I20260808 05:57:24.355717 16880 ts_manager.cc:194] Registered new tserver with Master: 9e3901e2dab342c39d972282b75e5ec3 (127.2.191.66:42169)
I20260808 05:57:24.356559 16880 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:44285
I20260808 05:57:24.366743 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:57:24.380337 17409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.368604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41562 (local address 127.2.191.126:34511)
0808 05:57:24.369239 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:24.369244 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:24.369264 (+ 20us) server_negotiation.cc:407] Connection header received
0808 05:57:24.369442 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:24.369445 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:24.369501 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:24.369603 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:24.370539 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.371403 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.372686 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.373111 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.373226 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.375679 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:24.375683 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:24.375686 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:24.375717 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:24.377851 (+ 2134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:24.378405 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:24.378408 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:24.378410 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:24.378512 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:24.378858 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:24.378861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:24.378863 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:24.379129 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:24.379265 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:24.379997 (+ 732us) server_negotiation.cc:299] Negotiation successful
0808 05:57:24.380143 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":126,"threads_started":1}
I20260808 05:57:24.385231 16880 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41562:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:57:24.390128 16880 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:57:24.416801 17417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.408030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:36929 (local address 127.0.0.1:42750)
0808 05:57:24.410781 (+ 2751us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:24.410793 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:24.410862 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:24.411925 (+ 1063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:24.411931 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:24.411955 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:24.412123 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.412129 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.413660 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.413663 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.415016 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.415029 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.416209 (+ 1180us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.416213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.416328 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.416378 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 05:57:24.416474 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 05:57:24.416604 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2692,"thread_start_us":112,"threads_started":1}
I20260808 05:57:24.417933 17415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.408220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:34643 (local address 127.0.0.1:53332)
0808 05:57:24.411010 (+ 2790us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:24.411022 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:24.411185 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:24.412347 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:24.412351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:24.412374 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:24.412465 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.412472 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.413930 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.413934 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.416058 (+ 2124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.416070 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.417499 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.417503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.417606 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.417635 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 05:57:24.417716 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 05:57:24.417790 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2742,"thread_start_us":106,"threads_started":1}
I20260808 05:57:24.417956 17419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.408508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42750 (local address 127.2.191.65:36929)
0808 05:57:24.411448 (+ 2940us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:24.411455 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:24.411478 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:57:24.411552 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:24.411557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:24.411750 (+ 193us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:24.412281 (+ 531us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:24.412414 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.413535 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.415203 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.416037 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.417495 (+ 1458us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.417645 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:24.417701 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 05:57:24.417805 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2826,"thread_start_us":131,"threads_started":1}
I20260808 05:57:24.418438 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.408660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53332 (local address 127.2.191.67:34643)
0808 05:57:24.410000 (+ 1340us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:24.410009 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:24.411103 (+ 1094us) server_negotiation.cc:407] Connection header received
0808 05:57:24.411358 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:24.411365 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:24.411628 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:24.411806 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:24.412612 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.413786 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.416215 (+ 2429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.417144 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.417254 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.417424 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:24.418141 (+ 717us) server_negotiation.cc:299] Negotiation successful
0808 05:57:24.418302 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1213,"thread_start_us":134,"threads_started":1}
I20260808 05:57:24.421854 17003 tablet_service.cc:1467] Processing CreateTablet for tablet d33c1510aeee4b4eb44f7c8062396388 (DEFAULT_TABLE table=test-table [id=d26c8f7a8f0147a2b19485047899b414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:24.421854 17313 tablet_service.cc:1467] Processing CreateTablet for tablet d33c1510aeee4b4eb44f7c8062396388 (DEFAULT_TABLE table=test-table [id=d26c8f7a8f0147a2b19485047899b414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:24.423121 17313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d33c1510aeee4b4eb44f7c8062396388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:24.423113 17003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d33c1510aeee4b4eb44f7c8062396388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:24.433077 17418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.403144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:42169 (local address 127.0.0.1:45980)
0808 05:57:24.410330 (+ 7186us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:24.410407 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:24.410554 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:24.413404 (+ 2850us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:24.413407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:24.413423 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:24.413529 (+ 106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.413535 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.426187 (+ 12652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.426192 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.427410 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.427426 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.432520 (+ 5094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.432525 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.432659 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.432695 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 05:57:24.432790 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 05:57:24.432892 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6950,"thread_start_us":129,"threads_started":1}
I20260808 05:57:24.434154 17416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.406977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45980 (local address 127.2.191.66:42169)
0808 05:57:24.412953 (+ 5976us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:24.412960 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:24.412984 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:57:24.413060 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:24.413065 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:24.413246 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:24.413700 (+ 454us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:24.413863 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.419184 (+ 5321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.431330 (+ 12146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.432353 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.433638 (+ 1285us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.433820 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:24.433889 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 05:57:24.434005 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5858,"thread_start_us":146,"threads_started":1}
I20260808 05:57:24.434243 17421 tablet_bootstrap.cc:492] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: Bootstrap starting.
I20260808 05:57:24.436846 17421 tablet_bootstrap.cc:654] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:24.437862 17421 log.cc:824] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:24.437633 17170 tablet_service.cc:1467] Processing CreateTablet for tablet d33c1510aeee4b4eb44f7c8062396388 (DEFAULT_TABLE table=test-table [id=d26c8f7a8f0147a2b19485047899b414]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:24.438802 17170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d33c1510aeee4b4eb44f7c8062396388. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:24.442431 17421 tablet_bootstrap.cc:492] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: No bootstrap required, opened a new log
I20260808 05:57:24.442656 17421 ts_tablet_manager.cc:1397] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260808 05:57:24.448228 17421 raft_consensus.cc:348] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
I20260808 05:57:24.448746 17421 raft_consensus.cc:374] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:24.448879 17421 raft_consensus.cc:729] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdfc6f7088d648af81021da9f7d8910e, State: Initialized, Role: FOLLOWER
I20260808 05:57:24.449510 17421 consensus_queue.cc:260] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
I20260808 05:57:24.449644 17423 tablet_bootstrap.cc:492] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2: Bootstrap starting.
I20260808 05:57:24.450790 17421 ts_tablet_manager.cc:1428] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: Time spent starting tablet: real 0.008s user 0.002s sys 0.004s
I20260808 05:57:24.451251 17386 heartbeater.cc:503] Master 127.2.191.126:34511 was elected leader, sending a full tablet report...
I20260808 05:57:24.453423 17423 tablet_bootstrap.cc:654] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:24.453871 17424 tablet_bootstrap.cc:492] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Bootstrap starting.
I20260808 05:57:24.454952 17423 log.cc:824] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:24.457713 17423 tablet_bootstrap.cc:492] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2: No bootstrap required, opened a new log
I20260808 05:57:24.457958 17423 ts_tablet_manager.cc:1397] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
Aug 08 05:57:24 dist-test-slave-qg60 krb5kdc[15799](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168644, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for HTTP/127.2.191.84@KRBTEST.COM
I20260808 05:57:24.457913 17424 tablet_bootstrap.cc:654] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:24.461001 17424 log.cc:824] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:24.464290 17424 tablet_bootstrap.cc:492] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: No bootstrap required, opened a new log
I20260808 05:57:24.464505 17424 ts_tablet_manager.cc:1397] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260808 05:57:24.463701 17423 raft_consensus.cc:348] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
I20260808 05:57:24.465240 17423 raft_consensus.cc:374] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:24.465299 17423 raft_consensus.cc:729] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fc3c682fa0a447198d23d6d15e641e2, State: Initialized, Role: FOLLOWER
I20260808 05:57:24.465889 17423 consensus_queue.cc:260] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
I20260808 05:57:24.467222 17423 ts_tablet_manager.cc:1428] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2: Time spent starting tablet: real 0.009s user 0.003s sys 0.005s
I20260808 05:57:24.467573 17097 heartbeater.cc:503] Master 127.2.191.126:34511 was elected leader, sending a full tablet report...
I20260808 05:57:24.469616 17424 raft_consensus.cc:348] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
I20260808 05:57:24.469938 17424 raft_consensus.cc:374] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:24.470031 17424 raft_consensus.cc:729] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e3901e2dab342c39d972282b75e5ec3, State: Initialized, Role: FOLLOWER
I20260808 05:57:24.470577 17424 consensus_queue.cc:260] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
I20260808 05:57:24.472050 17424 ts_tablet_manager.cc:1428] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20260808 05:57:24.472469 17242 heartbeater.cc:503] Master 127.2.191.126:34511 was elected leader, sending a full tablet report...
W20260808 05:57:24.540247 17098 tablet.cc:2369] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:57:24.554136 17428 raft_consensus.cc:482] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:24.554445 17428 raft_consensus.cc:504] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
I20260808 05:57:24.555915 17428 leader_election.cc:288] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9e3901e2dab342c39d972282b75e5ec3 (127.2.191.66:42169), fdfc6f7088d648af81021da9f7d8910e (127.2.191.67:34643)
I20260808 05:57:24.562105 17416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.556716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:40517 (local address 127.2.191.66:42169)
0808 05:57:24.556925 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:24.556931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:24.557060 (+ 129us) server_negotiation.cc:407] Connection header received
0808 05:57:24.557309 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:24.557312 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:24.557363 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:24.557413 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:24.557979 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.558747 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.560611 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.561258 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.561350 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.561407 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:24.561872 (+ 465us) server_negotiation.cc:299] Negotiation successful
0808 05:57:24.561972 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260808 05:57:24.562105 17420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.556766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:47471 (local address 127.2.191.67:34643)
0808 05:57:24.556926 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:24.556932 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:24.557053 (+ 121us) server_negotiation.cc:407] Connection header received
0808 05:57:24.557285 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:24.557288 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:24.557338 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:24.557390 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:24.557938 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.558746 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.560611 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.561240 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.561349 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.561407 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:24.561872 (+ 465us) server_negotiation.cc:299] Negotiation successful
0808 05:57:24.561959 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:57:24.562621 17431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.556218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:34643 (local address 127.2.191.65:47471)
0808 05:57:24.556956 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:24.556968 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:24.557142 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:24.557556 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:24.557559 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:24.557579 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:24.557769 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.557787 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.558913 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.558916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.560451 (+ 1535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.560465 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.561514 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.561518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.561661 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.561736 (+ 75us) client_negotiation.cc:769] Sending connection context
0808 05:57:24.562345 (+ 609us) client_negotiation.cc:240] Negotiation successful
0808 05:57:24.562438 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"mutex_wait_us":132,"spinlock_wait_cycles":1920,"thread_start_us":176,"threads_started":1}
I20260808 05:57:24.562994 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.556110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:42169 (local address 127.2.191.65:40517)
0808 05:57:24.556934 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:24.556952 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:24.557171 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:24.557557 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:24.557560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:24.557593 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:24.557824 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.557834 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.559058 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.559063 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.560451 (+ 1388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:24.560465 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.561514 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.561518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:24.561682 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.561747 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 05:57:24.562566 (+ 819us) client_negotiation.cc:240] Negotiation successful
0808 05:57:24.562638 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":731,"mutex_wait_us":109,"spinlock_wait_cycles":50688,"thread_start_us":174,"threads_started":1}
I20260808 05:57:24.563681 17335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33c1510aeee4b4eb44f7c8062396388" candidate_uuid: "3fc3c682fa0a447198d23d6d15e641e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdfc6f7088d648af81021da9f7d8910e" is_pre_election: true
I20260808 05:57:24.563895 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33c1510aeee4b4eb44f7c8062396388" candidate_uuid: "3fc3c682fa0a447198d23d6d15e641e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3901e2dab342c39d972282b75e5ec3" is_pre_election: true
I20260808 05:57:24.564076 17335 raft_consensus.cc:2454] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc3c682fa0a447198d23d6d15e641e2 in term 0.
I20260808 05:57:24.564256 17190 raft_consensus.cc:2454] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3fc3c682fa0a447198d23d6d15e641e2 in term 0.
I20260808 05:57:24.564662 16973 leader_election.cc:302] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc3c682fa0a447198d23d6d15e641e2, fdfc6f7088d648af81021da9f7d8910e; no voters:
I20260808 05:57:24.565183 17428 raft_consensus.cc:2781] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:57:24.565285 17428 raft_consensus.cc:482] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:57:24.565342 17428 raft_consensus.cc:3037] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:24.566529 17428 raft_consensus.cc:504] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
I20260808 05:57:24.566907 17428 leader_election.cc:288] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [CANDIDATE]: Term 1 election: Requested vote from peers 9e3901e2dab342c39d972282b75e5ec3 (127.2.191.66:42169), fdfc6f7088d648af81021da9f7d8910e (127.2.191.67:34643)
I20260808 05:57:24.567389 17190 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33c1510aeee4b4eb44f7c8062396388" candidate_uuid: "3fc3c682fa0a447198d23d6d15e641e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9e3901e2dab342c39d972282b75e5ec3"
I20260808 05:57:24.567435 17335 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d33c1510aeee4b4eb44f7c8062396388" candidate_uuid: "3fc3c682fa0a447198d23d6d15e641e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fdfc6f7088d648af81021da9f7d8910e"
I20260808 05:57:24.567576 17190 raft_consensus.cc:3037] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:24.567589 17335 raft_consensus.cc:3037] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:24.568876 17190 raft_consensus.cc:2454] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc3c682fa0a447198d23d6d15e641e2 in term 1.
I20260808 05:57:24.569150 17335 raft_consensus.cc:2454] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3fc3c682fa0a447198d23d6d15e641e2 in term 1.
I20260808 05:57:24.569330 16974 leader_election.cc:302] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fc3c682fa0a447198d23d6d15e641e2, 9e3901e2dab342c39d972282b75e5ec3; no voters:
I20260808 05:57:24.569576 17428 raft_consensus.cc:2781] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:24.569828 17428 raft_consensus.cc:686] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [term 1 LEADER]: Becoming Leader. State: Replica: 3fc3c682fa0a447198d23d6d15e641e2, State: Running, Role: LEADER
I20260808 05:57:24.570189 17428 consensus_queue.cc:237] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } }
W20260808 05:57:24.573446 17243 tablet.cc:2369] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:57:24.573457 16880 catalog_manager.cc:5495] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3fc3c682fa0a447198d23d6d15e641e2 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "3fc3c682fa0a447198d23d6d15e641e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3fc3c682fa0a447198d23d6d15e641e2" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 36929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 } health_report { overall_health: UNKNOWN } } }
I20260808 05:57:24.599581 17419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.595645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42754 (local address 127.2.191.65:36929)
0808 05:57:24.595780 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:24.595783 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:24.595905 (+ 122us) server_negotiation.cc:407] Connection header received
0808 05:57:24.596102 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:24.596104 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:24.596177 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:24.596314 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:57:24.596588 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.597171 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.598055 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:24.598282 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:24.598394 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:24.598721 (+ 327us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:57:24.599160 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:57:24.599299 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:24.599341 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 05:57:24.599403 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:57:24.606870 17335 raft_consensus.cc:1261] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 1 FOLLOWER]: Refusing update from remote peer 3fc3c682fa0a447198d23d6d15e641e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:24.607693 17428 consensus_queue.cc:1035] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fdfc6f7088d648af81021da9f7d8910e" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 34643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:24.607868 17190 raft_consensus.cc:1261] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 1 FOLLOWER]: Refusing update from remote peer 3fc3c682fa0a447198d23d6d15e641e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:24.608831 17428 consensus_queue.cc:1035] T d33c1510aeee4b4eb44f7c8062396388 P 3fc3c682fa0a447198d23d6d15e641e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9e3901e2dab342c39d972282b75e5ec3" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:24.623258 17436 mvcc.cc:205] Tried to move back new op lower bound from 7316146768301490176 to 7316146768162689024. Current Snapshot: MvccSnapshot[applied={T|T < 7316146768301490176}]
I20260808 05:57:24.627926 17437 mvcc.cc:205] Tried to move back new op lower bound from 7316146768301490176 to 7316146768162689024. Current Snapshot: MvccSnapshot[applied={T|T < 7316146768301490176}]
I20260808 05:57:24.636046 17439 mvcc.cc:205] Tried to move back new op lower bound from 7316146768301490176 to 7316146768162689024. Current Snapshot: MvccSnapshot[applied={T|T < 7316146768301490176}]
I20260808 05:57:24.636385 16880 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:57:24.636551 16880 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:57:24.639236 16880 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c185e458a784fc49e6b86cc1a70299f: Sending DeleteTablet for 3 replicas of tablet d33c1510aeee4b4eb44f7c8062396388
I20260808 05:57:24.640380 17313 tablet_service.cc:1514] Processing DeleteTablet for tablet d33c1510aeee4b4eb44f7c8062396388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:24 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:53332
I20260808 05:57:24.641934 17170 tablet_service.cc:1514] Processing DeleteTablet for tablet d33c1510aeee4b4eb44f7c8062396388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:24 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:45980
I20260808 05:57:24.642495 17003 tablet_service.cc:1514] Processing DeleteTablet for tablet d33c1510aeee4b4eb44f7c8062396388 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:24 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:42750
I20260808 05:57:24.643909 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 16920
I20260808 05:57:24.645090 17445 tablet_replica.cc:330] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: stopping tablet replica
I20260808 05:57:24.645466 17445 raft_consensus.cc:2229] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:57:24.645821 17445 raft_consensus.cc:2258] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:24.646275 17446 tablet_replica.cc:330] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: stopping tablet replica
I20260808 05:57:24.646586 17446 raft_consensus.cc:2229] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:57:24.646893 17446 raft_consensus.cc:2258] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:24.650452 17446 ts_tablet_manager.cc:1905] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:24.648684 17445 ts_tablet_manager.cc:1905] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:24.654132 17446 ts_tablet_manager.cc:1918] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:24.654379 17446 log.cc:1196] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/d33c1510aeee4b4eb44f7c8062396388
I20260808 05:57:24.654953 17446 ts_tablet_manager.cc:1939] T d33c1510aeee4b4eb44f7c8062396388 P 9e3901e2dab342c39d972282b75e5ec3: Deleting consensus metadata
I20260808 05:57:24.657886 16866 catalog_manager.cc:4841] TS 9e3901e2dab342c39d972282b75e5ec3 (127.2.191.66:42169): tablet d33c1510aeee4b4eb44f7c8062396388 (table test-table [id=d26c8f7a8f0147a2b19485047899b414]) successfully deleted
I20260808 05:57:24.660920 17445 ts_tablet_manager.cc:1918] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:24.663003 17445 log.cc:1196] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/d33c1510aeee4b4eb44f7c8062396388
I20260808 05:57:24.663492 17445 ts_tablet_manager.cc:1939] T d33c1510aeee4b4eb44f7c8062396388 P fdfc6f7088d648af81021da9f7d8910e: Deleting consensus metadata
W20260808 05:57:24.666519 16866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:36929 (error 108)
I20260808 05:57:24.668110 17418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:24.667781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:36929 (local address 127.0.0.1:42768)
0808 05:57:24.667964 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:24.668026 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:36929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
W20260808 05:57:24.668406 16866 catalog_manager.cc:4584] TS 3fc3c682fa0a447198d23d6d15e641e2 (127.2.191.65:36929): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d33c1510aeee4b4eb44f7c8062396388: Network error: Client connection negotiation failed: client connection to 127.2.191.65:36929: connect: Connection refused (error 111)
I20260808 05:57:24.668828 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 17101
I20260808 05:57:24.669023 16865 catalog_manager.cc:4841] TS fdfc6f7088d648af81021da9f7d8910e (127.2.191.67:34643): tablet d33c1510aeee4b4eb44f7c8062396388 (table test-table [id=d26c8f7a8f0147a2b19485047899b414]) successfully deleted
I20260808 05:57:24.686406 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 17245
I20260808 05:57:24.696086 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 16847
I20260808 05:57:24.705693 2813 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 05:57:25.050709 2813 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 05:57:25.050841 2813 mini_ranger.cc:66] Stopping Ranger...
I20260808 05:57:25.396431 2813 mini_ranger.cc:68] Stopped Ranger
2026-08-08 05:57:25.396 UTC [15831] LOG: received smart shutdown request
2026-08-08 05:57:25.400 UTC [15831] LOG: background worker "logical replication launcher" (PID 15840) exited with exit code 1
2026-08-08 05:57:25.400 UTC [15835] LOG: shutting down
2026-08-08 05:57:25.577 UTC [15831] LOG: database system is shut down
2026-08-08T05:57:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (50234 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:57:25 dist-test-slave-qg60 krb5kdc[17459](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:57:25 dist-test-slave-qg60 krb5kdc[17459](info): set up 2 sockets
Aug 08 05:57:25 dist-test-slave-qg60 krb5kdc[17459](info): commencing operation
krb5kdc: starting...
W20260808 05:57:26.818547 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:57:26 dist-test-slave-qg60 krb5kdc[17459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:57:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:57:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:57:26.953241 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34487
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:34487,127.2.191.125:35571,127.2.191.124:39129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:27.069718 17474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:27.069983 17474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:27.070025 17474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:27.074120 17474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:27.074182 17474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:27.074201 17474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:27.074218 17474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:27.074270 17474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:27.079784 17474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:34487,127.2.191.125:35571,127.2.191.124:39129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:34487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:27.080955 17474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:27.082018 17474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:27.090728 17481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:27.090728 17480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:27.090740 17483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:27.091048 17474 server_base.cc:1034] running on GCE node
I20260808 05:57:27.091709 17474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:27.092955 17474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:27.094177 17474 hybrid_clock.cc:648] HybridClock initialized: now 1786168647094147 us; error 50 us; skew 500 ppm
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:27.097535 17474 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:57:27.098574 17474 webserver.cc:460] Webserver started at http://127.2.191.126:37853/ using document root <none> and password file <none>
I20260808 05:57:27.099188 17474 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:27.099292 17474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:27.099546 17474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:27.101861 17474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "c28faa63370240e271271dc2a18e67d0"
server_key_iv: "8bc8819997e4f8f0395def647707d57e"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.102466 17474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "c28faa63370240e271271dc2a18e67d0"
server_key_iv: "8bc8819997e4f8f0395def647707d57e"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.106411 17474 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 05:57:27.109030 17491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:27.110344 17474 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 05:57:27.110536 17474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "c28faa63370240e271271dc2a18e67d0"
server_key_iv: "8bc8819997e4f8f0395def647707d57e"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.110663 17474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:27.126531 17474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:27.130122 17474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:27.130355 17474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:27.139199 17549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:34487 every 8 connection(s)
I20260808 05:57:27.139195 17474 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:34487
I20260808 05:57:27.140326 17474 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:57:27.141216 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 17474
I20260808 05:57:27.141333 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:57:27.141656 2813 external_mini_cluster.cc:1428] Setting key e8a580491d286ac85b0d37e88ba44dfa
I20260808 05:57:27.143512 17550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:27.149693 17550 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.2.191.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.125@KRBTEST.COM" created.
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:27.167845 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.152847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34487 (local address 127.0.0.1:59926)
0808 05:57:27.153388 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.153461 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.154358 (+ 897us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.155129 (+ 771us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.155133 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.155493 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.155842 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.155866 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.157731 (+ 1865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.157733 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.158456 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.158464 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.159448 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.159451 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.159584 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.160327 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.160352 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.162227 (+ 1875us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.164385 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.164395 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.164406 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.164689 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.165100 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.165103 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.165105 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.165227 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.165879 (+ 652us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.165886 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.166046 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.166237 (+ 191us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.166626 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":54,"thread_start_us":168,"threads_started":1}
I20260808 05:57:27.167845 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.152847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59926 (local address 127.2.191.126:34487)
0808 05:57:27.153817 (+ 970us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.153836 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.153904 (+ 68us) server_negotiation.cc:407] Connection header received
0808 05:57:27.154687 (+ 783us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.154694 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.154899 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.155148 (+ 249us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.156067 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.157593 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.158581 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.159276 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.159474 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.162393 (+ 2919us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.162400 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.162411 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.162433 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.164243 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.164866 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.164872 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.164874 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.164992 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.165330 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.165333 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.165335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.165747 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.165897 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.166325 (+ 428us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.166684 (+ 359us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":192,"server-negotiator.queue_time_us":839,"spinlock_wait_cycles":53504,"thread_start_us":168,"threads_started":1}
I20260808 05:57:27.170599 17550 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:57:27.171542 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.171237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38330)
0808 05:57:27.171365 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.171465 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 05:57:27.171797 17493 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
I20260808 05:57:27.172878 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.172628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38334)
0808 05:57:27.172762 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.172816 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 05:57:27.173071 17550 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:35571: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab.
Entry for principal kudu/127.2.191.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab.
I20260808 05:57:27.177047 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.125:35571
--webserver_interface=127.2.191.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab
--principal=kudu/127.2.191.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:34487,127.2.191.125:35571,127.2.191.124:39129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:27.222328 17550 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } attempt: 1
I20260808 05:57:27.223395 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.223032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38336)
0808 05:57:27.223216 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.223296 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 05:57:27.224251 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.224008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38340)
0808 05:57:27.224121 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.224177 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 05:57:27.224424 17550 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:35571: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
I20260808 05:57:27.292610 17550 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } attempt: 2
I20260808 05:57:27.293514 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.293153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38352)
0808 05:57:27.293342 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.293417 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 05:57:27.294260 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.294053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38358)
0808 05:57:27.294154 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.294200 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 05:57:27.294402 17550 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:35571: Network error: Client connection negotiation failed: client connection to 127.2.191.125:35571: connect: Connection refused (error 111)
W20260808 05:57:27.294942 17557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:27.295179 17557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:27.295291 17557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:27.299325 17557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:27.299379 17557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:27.299422 17557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:27.299458 17557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:27.299513 17557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:27.304926 17557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:34487,127.2.191.125:35571,127.2.191.124:39129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab
--principal=kudu/127.2.191.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.125:35571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.191.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:27.305968 17557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:27.306975 17557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:57:27.315758 17557 server_base.cc:1034] running on GCE node
W20260808 05:57:27.315694 17564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:27.315694 17563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:27.315698 17567 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:27.316603 17557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:27.317839 17557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:27.319023 17557 hybrid_clock.cc:648] HybridClock initialized: now 1786168647319011 us; error 28 us; skew 500 ppm
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:27.321929 17557 init.cc:377] Logged in from keytab as kudu/127.2.191.125@KRBTEST.COM (short username kudu)
I20260808 05:57:27.322841 17557 webserver.cc:460] Webserver started at http://127.2.191.125:39649/ using document root <none> and password file <none>
I20260808 05:57:27.323423 17557 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:27.323520 17557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:27.323757 17557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:27.325913 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/data/instance:
uuid: "afc10010096e4676b4536e0c3499709b"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "473c151f890b9839114e6f43afa66fb3"
server_key_iv: "a25c194e496ed22a51dc399e28d44174"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.326509 17557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/wal/instance:
uuid: "afc10010096e4676b4536e0c3499709b"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "473c151f890b9839114e6f43afa66fb3"
server_key_iv: "a25c194e496ed22a51dc399e28d44174"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.330425 17557 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:57:27.332993 17574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:27.334307 17557 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:57:27.334444 17557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/wal
uuid: "afc10010096e4676b4536e0c3499709b"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "473c151f890b9839114e6f43afa66fb3"
server_key_iv: "a25c194e496ed22a51dc399e28d44174"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.334559 17557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:27.352592 17557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:27.355589 17557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:27.355803 17557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:27.363343 17557 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.125:35571
I20260808 05:57:27.363368 17629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.125:35571 every 8 connection(s)
I20260808 05:57:27.364318 17557 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
I20260808 05:57:27.364647 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 17557
I20260808 05:57:27.364812 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-1/wal/instance
I20260808 05:57:27.365190 2813 external_mini_cluster.cc:1428] Setting key 6d163f35a321b2133b644569858c4599
I20260808 05:57:27.367270 17630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:27.371279 17630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.2.191.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.124@KRBTEST.COM" created.
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:27.385572 17550 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } attempt: 3
I20260808 05:57:27.386751 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.373382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59940 (local address 127.2.191.126:34487)
0808 05:57:27.373527 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.373531 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.374628 (+ 1097us) server_negotiation.cc:407] Connection header received
0808 05:57:27.375666 (+ 1038us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.375669 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.375722 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.375800 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.377459 (+ 1659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.378003 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.379562 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.379960 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.380096 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.382727 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.382731 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.382739 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.382764 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.384331 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.384926 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.384930 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.384932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.385013 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.385374 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.385378 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.385379 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.385603 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.385703 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.386398 (+ 695us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.386565 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260808 05:57:27.387517 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.373909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34487 (local address 127.0.0.1:59940)
0808 05:57:27.374427 (+ 518us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.374500 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.375464 (+ 964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.376070 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.376077 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.376494 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.377265 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.377287 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.378174 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.378181 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.379425 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.379441 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.380119 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.380122 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.380284 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.380983 (+ 699us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.381000 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.382555 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.384477 (+ 1922us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.384483 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.384498 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.384827 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.385108 (+ 281us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.385111 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.385113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.385256 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.385737 (+ 481us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.385748 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.386084 (+ 336us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.386313 (+ 229us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.386636 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"thread_start_us":126,"threads_started":1}
I20260808 05:57:27.389034 17630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab.
Entry for principal kudu/127.2.191.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab.
I20260808 05:57:27.396422 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.124:39129
--webserver_interface=127.2.191.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab
--principal=kudu/127.2.191.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:34487,127.2.191.125:35571,127.2.191.124:39129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:27.397233 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.386039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38360)
0808 05:57:27.386226 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.386238 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.386321 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.387084 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.387087 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.387308 (+ 221us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.387871 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.387880 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.389336 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.389340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.389944 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.389957 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.390654 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.390661 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.390770 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.391266 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.391282 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.392853 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.395276 (+ 2423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.395279 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.395282 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.395544 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.395887 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.395890 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.395893 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.395997 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.396627 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.396632 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.396780 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.396900 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.397054 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123}
I20260808 05:57:27.397389 17635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.386153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38360 (local address 127.2.191.125:35571)
0808 05:57:27.386630 (+ 477us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.386643 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.386665 (+ 22us) server_negotiation.cc:407] Connection header received
0808 05:57:27.386706 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.386711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.386926 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.387183 (+ 257us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.388166 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.389173 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.390066 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.390513 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.390680 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.392993 (+ 2313us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.393007 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.393046 (+ 39us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.393076 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.395166 (+ 2090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.395671 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.395677 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.395679 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.395785 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.396114 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.396120 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.396125 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.396492 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.396650 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.397022 (+ 372us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.397176 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":51,"server-negotiator.queue_time_us":365,"thread_start_us":138,"threads_started":1}
I20260808 05:57:27.399668 17550 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:57:27.400226 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.389662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38370)
0808 05:57:27.389750 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.389764 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.389885 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.390399 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.390402 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.390618 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.390825 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.390833 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.392014 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.392018 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.392920 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.392932 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.393594 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.393598 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.393751 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.394239 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.394260 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.395677 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.398766 (+ 3089us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.398773 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.398775 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.398959 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.399239 (+ 280us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.399243 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.399245 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.399338 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.399770 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.399774 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.399853 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.399948 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.400089 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28,"mutex_wait_us":74}
I20260808 05:57:27.400774 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.400201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48658)
0808 05:57:27.400599 (+ 398us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.400658 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 05:57:27.400835 17636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.389793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38370 (local address 127.2.191.125:35571)
0808 05:57:27.390206 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.390214 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.390225 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:57:27.390253 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.390255 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.390285 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.390359 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.390948 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.391916 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.393127 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.393494 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.393596 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.395840 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.395845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.395847 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.395874 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.398660 (+ 2786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.399052 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.399056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.399058 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.399151 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.399427 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.399430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.399432 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.399642 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.399736 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.400496 (+ 760us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.400622 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":240,"server-negotiator.queue_time_us":351,"thread_start_us":152,"threads_started":1}
I20260808 05:57:27.401527 17630 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:57:27.401934 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.401368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48668)
0808 05:57:27.401833 (+ 465us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.401880 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260808 05:57:27.402086 17550 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:39129: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
I20260808 05:57:27.402364 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.401985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48674)
0808 05:57:27.402191 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.402277 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125}
W20260808 05:57:27.402592 17577 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
I20260808 05:57:27.403579 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.403296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48682)
0808 05:57:27.403425 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.403500 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 05:57:27.403760 17630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:39129: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
I20260808 05:57:27.433279 17550 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } attempt: 1
I20260808 05:57:27.434301 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.433898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48686)
0808 05:57:27.434142 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.434214 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146}
I20260808 05:57:27.435137 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.434921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48688)
0808 05:57:27.435035 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.435082 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 05:57:27.435302 17550 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:39129: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
I20260808 05:57:27.453042 17630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } attempt: 1
I20260808 05:57:27.454068 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.453652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48700)
0808 05:57:27.453858 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.453956 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 05:57:27.455065 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.454764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48712)
0808 05:57:27.454935 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.454997 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 05:57:27.455245 17630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:39129: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
I20260808 05:57:27.510474 17550 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } attempt: 2
I20260808 05:57:27.511479 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.511093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48722)
0808 05:57:27.511285 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.511375 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260808 05:57:27.512300 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.512108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48736)
0808 05:57:27.512207 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.512252 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 05:57:27.512658 17550 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:39129: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
W20260808 05:57:27.517498 17637 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:27.517745 17637 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:27.517786 17637 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:27.521836 17637 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:27.521888 17637 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:27.521906 17637 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:27.521929 17637 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:27.521945 17637 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:27.523423 17630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } attempt: 2
I20260808 05:57:27.524199 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.523885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48752)
0808 05:57:27.524047 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.524115 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260808 05:57:27.524932 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.524699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48764)
0808 05:57:27.524819 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.524870 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260808 05:57:27.525074 17630 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:39129: Network error: Client connection negotiation failed: client connection to 127.2.191.124:39129: connect: Connection refused (error 111)
I20260808 05:57:27.527863 17637 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:34487,127.2.191.125:35571,127.2.191.124:39129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab
--principal=kudu/127.2.191.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.124:39129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.191.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17637
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:27.529021 17637 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:27.530055 17637 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:27.538970 17644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:27.539080 17637 server_base.cc:1034] running on GCE node
W20260808 05:57:27.539005 17645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:27.538970 17647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:27.539878 17637 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:27.541041 17637 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:27.542215 17637 hybrid_clock.cc:648] HybridClock initialized: now 1786168647542196 us; error 29 us; skew 500 ppm
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:27.545220 17637 init.cc:377] Logged in from keytab as kudu/127.2.191.124@KRBTEST.COM (short username kudu)
I20260808 05:57:27.546097 17637 webserver.cc:460] Webserver started at http://127.2.191.124:45413/ using document root <none> and password file <none>
I20260808 05:57:27.546635 17637 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:27.546694 17637 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:27.546866 17637 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:27.549007 17637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/data/instance:
uuid: "dec769302f0d42dd84d2150a08201d99"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "0a8741bd934f3ff27e9edffec7a404fd"
server_key_iv: "1fdd53f7bc8e4cd3be9f6c1d32dd6ff9"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.549556 17637 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/wal/instance:
uuid: "dec769302f0d42dd84d2150a08201d99"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "0a8741bd934f3ff27e9edffec7a404fd"
server_key_iv: "1fdd53f7bc8e4cd3be9f6c1d32dd6ff9"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.553586 17637 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:57:27.556084 17655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:27.557446 17637 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:57:27.557606 17637 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/wal
uuid: "dec769302f0d42dd84d2150a08201d99"
format_stamp: "Formatted at 2026-08-08 05:57:27 on dist-test-slave-qg60"
server_key: "0a8741bd934f3ff27e9edffec7a404fd"
server_key_iv: "1fdd53f7bc8e4cd3be9f6c1d32dd6ff9"
server_key_version: "encryptionkey@0"
I20260808 05:57:27.557722 17637 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:27.576892 17637 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:27.579886 17637 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:27.580099 17637 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:27.587122 17637 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.124:39129
I20260808 05:57:27.587193 17713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.124:39129 every 8 connection(s)
I20260808 05:57:27.588135 17637 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
I20260808 05:57:27.591203 17714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:27.593863 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 17637
I20260808 05:57:27.594003 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786168478015505-2813-0/minicluster-data/master-2/wal/instance
I20260808 05:57:27.594350 2813 external_mini_cluster.cc:1428] Setting key 20ad6b97b96515d854b4f5d4ed8e2ed7
I20260808 05:57:27.596077 17714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:27.609668 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.598133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59952 (local address 127.2.191.126:34487)
0808 05:57:27.598286 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.598292 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.598998 (+ 706us) server_negotiation.cc:407] Connection header received
0808 05:57:27.599167 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.599169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.599218 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.599295 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.600154 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.600990 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.602188 (+ 1198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.602566 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.602679 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.605513 (+ 2834us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.605518 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.605522 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.605589 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.607402 (+ 1813us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.607982 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.607986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.607988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.608095 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.608528 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.608531 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.608534 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.608803 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.608928 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.609317 (+ 389us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.609448 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 05:57:27.610783 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.598032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:34487 (local address 127.0.0.1:59952)
0808 05:57:27.598851 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.598899 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.599024 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.599373 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.599378 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.599817 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.600004 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.600017 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.601111 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.601114 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.602020 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.602031 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.602735 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.602740 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.602871 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.603380 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.603396 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.605364 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.607508 (+ 2144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.607516 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.607524 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.607870 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.608204 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.608207 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.608209 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.608418 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.608911 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.608928 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.609063 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.609251 (+ 188us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.609709 (+ 458us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":642,"spinlock_wait_cycles":3328,"thread_start_us":142,"threads_started":1}
I20260808 05:57:27.610800 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.595868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48776 (local address 127.2.191.124:39129)
0808 05:57:27.596361 (+ 493us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.596377 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.596413 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:57:27.597130 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.597149 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.597488 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.597840 (+ 352us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.598801 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.600235 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.601447 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.602107 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.602248 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.605024 (+ 2776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.605030 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.605044 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.605078 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.606927 (+ 1849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.607703 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.607709 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.607711 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.607837 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.608204 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.608207 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.608208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.608819 (+ 611us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.609030 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.609282 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.609655 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"spinlock_wait_cycles":1280,"thread_start_us":171,"threads_started":1}
I20260808 05:57:27.611804 17550 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } attempt: 3
I20260808 05:57:27.612506 17714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:57:27.616226 17630 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } attempt: 3
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:27.622177 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.612217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48782)
0808 05:57:27.612339 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.612354 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.612430 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.612752 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.612755 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.612958 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.613070 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.613077 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.613982 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.613986 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.614777 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.614787 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.615445 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.615449 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.615535 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.616059 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.616076 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.617733 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.620387 (+ 2654us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.620391 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.620393 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.620660 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.621032 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.621035 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.621037 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.621134 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.621636 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.621639 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.621749 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.621842 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.621978 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 05:57:27.622866 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.612284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48782 (local address 127.2.191.124:39129)
0808 05:57:27.612541 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.612544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.612553 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:57:27.612578 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.612581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.612637 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.612715 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.613161 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.613849 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.614888 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.615284 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.615756 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.617888 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.617892 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.617895 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.617924 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.620252 (+ 2328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.620810 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.620813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.620814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.620898 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.621258 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.621264 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.621267 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.621492 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.622448 (+ 956us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.622528 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.622671 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199}
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
I20260808 05:57:27.625149 17636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.613166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38386 (local address 127.2.191.125:35571)
0808 05:57:27.613302 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.613307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.613323 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:57:27.613409 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.613412 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.613471 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.613585 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.614468 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.615130 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.618332 (+ 3202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.618576 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.618690 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.620902 (+ 2212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.620906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.620909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.620938 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.622689 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.623556 (+ 867us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.623560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.623562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.623651 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.624117 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.624120 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.624122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.624353 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.624425 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.624846 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.624976 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:57:27.625708 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.613022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:35571 (local address 127.0.0.1:38386)
0808 05:57:27.613253 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.613266 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.613326 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.613632 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.613635 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.614200 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.614326 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.614334 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.615259 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.615262 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.618215 (+ 2953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.618224 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.618691 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.618694 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.618793 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.619230 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.619242 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.620750 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.622920 (+ 2170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.622924 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.622928 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.623438 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.623891 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.623897 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.623899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.623989 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.624505 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.624511 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.624607 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.625419 (+ 812us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.625561 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145}
I20260808 05:57:27.625932 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.613960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59964 (local address 127.2.191.126:34487)
0808 05:57:27.614055 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.614059 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.615078 (+ 1019us) server_negotiation.cc:407] Connection header received
0808 05:57:27.615220 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.615224 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.615265 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.615356 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.616092 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.616861 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.618149 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.618536 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.618618 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.621876 (+ 3258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.621883 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.621890 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.621924 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.623896 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.624373 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.624379 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.624383 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.624471 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.624846 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.624849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.624853 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.625044 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.625244 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.625647 (+ 403us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.625761 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:57:27.627120 17550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: Bootstrap starting.
I20260808 05:57:27.627743 17714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:57:27.629540 17633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.616643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48788)
0808 05:57:27.616851 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.616866 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.616947 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.617404 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.617407 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.617612 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.617708 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.617715 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.619874 (+ 2159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.619880 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.620926 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.620943 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.622615 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.622621 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.622992 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.623585 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.623607 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.625234 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.627779 (+ 2545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.627783 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.627785 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.628045 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.628396 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.628400 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.628402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.628496 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.629021 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.629025 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.629125 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.629212 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.629342 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260808 05:57:27.630483 17720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.616706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48788 (local address 127.2.191.124:39129)
0808 05:57:27.617144 (+ 438us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.617155 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.617168 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:57:27.617202 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.617205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.617246 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.617840 (+ 594us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.617931 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.619715 (+ 1784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.621148 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.622435 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.625383 (+ 2948us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.625502 (+ 119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.625506 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.625508 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.625527 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.627657 (+ 2130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.628178 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.628181 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.628183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.628281 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.628634 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.628637 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.628638 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.628879 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.630084 (+ 1205us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.630176 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.630297 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":366,"thread_start_us":122,"threads_started":1}
I20260808 05:57:27.631630 17550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: Neither blocks nor log segments found. Creating new log.
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168647, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
I20260808 05:57:27.632661 17550 log.cc:824] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:27.634506 17630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: Bootstrap starting.
I20260808 05:57:27.635135 17550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: No bootstrap required, opened a new log
I20260808 05:57:27.635923 17719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.628205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:39129 (local address 127.0.0.1:48802)
0808 05:57:27.628375 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:27.628384 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:27.628470 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:27.628671 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:27.628674 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:27.628859 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:27.628931 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.628935 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.629628 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.629632 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.630121 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:27.630128 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.630542 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.630545 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:27.630664 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.631133 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:27.631152 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:27.632474 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:27.634490 (+ 2016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.634492 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.634494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.634746 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.635002 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:27.635005 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:27.635006 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:27.635079 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:27.635455 (+ 376us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:27.635458 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:27.635527 (+ 69us) client_negotiation.cc:769] Sending connection context
0808 05:57:27.635638 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 05:57:27.635764 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":23}
I20260808 05:57:27.636813 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.628230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48802 (local address 127.2.191.124:39129)
0808 05:57:27.628317 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.628320 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.628437 (+ 117us) server_negotiation.cc:407] Connection header received
0808 05:57:27.628540 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.628543 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.628575 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.628663 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.629041 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.629507 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.630227 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.630444 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.630546 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.632610 (+ 2064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.632614 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.632616 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.632637 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.634381 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.634842 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.634845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.634847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.634917 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.635162 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.635165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.635166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.635345 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.635420 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.636200 (+ 780us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.636310 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":20,"server-negotiator.queue_time_us":31}
I20260808 05:57:27.637908 17630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:27.639025 17630 log.cc:824] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:27.639672 17714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99: Bootstrap starting.
I20260808 05:57:27.640273 17550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
I20260808 05:57:27.640530 17550 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:27.640625 17550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ca1d1ed0a1d489b8e93186eb2dd0061, State: Initialized, Role: FOLLOWER
I20260808 05:57:27.641222 17550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
I20260808 05:57:27.641638 17630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: No bootstrap required, opened a new log
Aug 08 05:57:27 dist-test-slave-qg60 krb5kdc[17459](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
I20260808 05:57:27.642402 17714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:27.642831 17550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:27.643409 17714 log.cc:824] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:27.646410 17636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.627476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38396 (local address 127.2.191.125:35571)
0808 05:57:27.628124 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.628129 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.628144 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:57:27.628178 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.628181 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.628223 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.628308 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.633725 (+ 5417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.634525 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.635652 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.635961 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.636043 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.642754 (+ 6711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.642758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.642761 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.642790 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.644412 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.644927 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.644930 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.644932 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.645018 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.645357 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.645360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.645362 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.645599 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.645764 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.646140 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.646264 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542}
I20260808 05:57:27.646700 17630 raft_consensus.cc:348] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
I20260808 05:57:27.647048 17630 raft_consensus.cc:374] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:27.647166 17630 raft_consensus.cc:729] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afc10010096e4676b4536e0c3499709b, State: Initialized, Role: FOLLOWER
I20260808 05:57:27.647775 17630 consensus_queue.cc:260] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
W20260808 05:57:27.649102 17736 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:57:27.649225 17736 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:57:27.649168 17723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.649466 17723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:57:27.651052 17630 sys_catalog.cc:564] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:27.651325 17714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99: No bootstrap required, opened a new log
I20260808 05:57:27.648226 17474 master_runner.cc:186] Error getting master registration for 127.2.191.125:35571: OK, instance_id { permanent_uuid: "afc10010096e4676b4536e0c3499709b" instance_seqno: 1786168647361349 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:57:27.652019 17474 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:57:27.652717 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260808 05:57:27.656970 17751 catalog_manager.cc:1558] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:57:27.657156 17751 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:57:27.659004 17714 raft_consensus.cc:348] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
I20260808 05:57:27.659389 17714 raft_consensus.cc:374] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:27.659497 17714 raft_consensus.cc:729] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec769302f0d42dd84d2150a08201d99, State: Initialized, Role: FOLLOWER
I20260808 05:57:27.660045 17714 consensus_queue.cc:260] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
I20260808 05:57:27.661767 17714 sys_catalog.cc:564] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:27.653959 17738 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.659278 17557 master_runner.cc:186] Error getting master registration for 127.2.191.124:39129: OK, instance_id { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" instance_seqno: 1786168647585100 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:57:27.662911 17557 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:57:27.662659 17738 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:57:27.663293 17761 sys_catalog.cc:455] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.663506 17761 sys_catalog.cc:458] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:57:27.668869 17772 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:57:27.669023 17772 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:57:27.669312 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.655471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.2.191.126:34487)
0808 05:57:27.655599 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.655605 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.657438 (+ 1833us) server_negotiation.cc:407] Connection header received
0808 05:57:27.657651 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.657655 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.657710 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.657770 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.658939 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.659807 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.661220 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.661599 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.661686 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.663820 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.663826 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.663829 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.663860 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.665731 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.667606 (+ 1875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.667611 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.667613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.667713 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.668080 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.668084 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.668086 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.668339 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.668453 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.668896 (+ 443us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.669135 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:57:27.671671 17637 master_runner.cc:263] No leader master found from master dec769302f0d42dd84d2150a08201d99
I20260808 05:57:27.671734 17637 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:57:27.674228 17636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.656669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38410 (local address 127.2.191.125:35571)
0808 05:57:27.656819 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.656825 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.665488 (+ 8663us) server_negotiation.cc:407] Connection header received
0808 05:57:27.665693 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.665697 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.665749 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.665802 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.666679 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.667392 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.668514 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.668879 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.668993 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.670783 (+ 1790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.670787 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.670790 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.670816 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.672369 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.672791 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.672796 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.672798 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.672904 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.673264 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.673268 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.673269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.673467 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.673568 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.673925 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.674044 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:57:27.679888 17718 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:27.656563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48808 (local address 127.2.191.124:39129)
0808 05:57:27.656680 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:27.656684 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:27.665979 (+ 9295us) server_negotiation.cc:407] Connection header received
0808 05:57:27.666596 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:27.666600 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:27.666647 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:27.666701 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:27.670900 (+ 4199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.671742 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.673185 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:27.673562 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:27.673648 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:27.675850 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:27.675855 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:27.675858 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:27.675886 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:27.677762 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.678338 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.678342 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.678344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.678443 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:27.678776 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:27.678780 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:27.678782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:27.679018 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:27.679151 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:27.679535 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 05:57:27.679669 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260808 05:57:27.831593 17662 tablet.cc:2369] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:57:27.857506 17580 tablet.cc:2369] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:57:27.882241 17497 tablet.cc:2369] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:57:27.961120 17761 raft_consensus.cc:482] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:27.961357 17761 raft_consensus.cc:504] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
I20260808 05:57:27.962399 17761 leader_election.cc:288] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9ca1d1ed0a1d489b8e93186eb2dd0061 (127.2.191.126:34487), afc10010096e4676b4536e0c3499709b (127.2.191.125:35571)
I20260808 05:57:27.962899 17522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dec769302f0d42dd84d2150a08201d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" is_pre_election: true
I20260808 05:57:27.962903 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dec769302f0d42dd84d2150a08201d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afc10010096e4676b4536e0c3499709b" is_pre_election: true
I20260808 05:57:27.963222 17602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec769302f0d42dd84d2150a08201d99 in term 0.
I20260808 05:57:27.963223 17522 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec769302f0d42dd84d2150a08201d99 in term 0.
I20260808 05:57:27.963685 17657 leader_election.cc:302] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 9ca1d1ed0a1d489b8e93186eb2dd0061, afc10010096e4676b4536e0c3499709b, dec769302f0d42dd84d2150a08201d99; no voters:
I20260808 05:57:27.963992 17761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:57:27.964089 17761 raft_consensus.cc:482] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:57:27.964138 17761 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:27.965260 17761 raft_consensus.cc:504] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
I20260808 05:57:27.965569 17761 leader_election.cc:288] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [CANDIDATE]: Term 1 election: Requested vote from peers 9ca1d1ed0a1d489b8e93186eb2dd0061 (127.2.191.126:34487), afc10010096e4676b4536e0c3499709b (127.2.191.125:35571)
I20260808 05:57:27.965870 17522 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dec769302f0d42dd84d2150a08201d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061"
I20260808 05:57:27.965905 17602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dec769302f0d42dd84d2150a08201d99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afc10010096e4676b4536e0c3499709b"
I20260808 05:57:27.966012 17522 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:27.966029 17602 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:27.967103 17602 raft_consensus.cc:2454] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec769302f0d42dd84d2150a08201d99 in term 1.
I20260808 05:57:27.967137 17522 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec769302f0d42dd84d2150a08201d99 in term 1.
I20260808 05:57:27.967389 17657 leader_election.cc:302] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: afc10010096e4676b4536e0c3499709b, dec769302f0d42dd84d2150a08201d99; no voters:
I20260808 05:57:27.967572 17761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:27.967775 17761 raft_consensus.cc:686] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [term 1 LEADER]: Becoming Leader. State: Replica: dec769302f0d42dd84d2150a08201d99, State: Running, Role: LEADER
I20260808 05:57:27.968135 17761 consensus_queue.cc:237] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } }
I20260808 05:57:27.970144 17774 sys_catalog.cc:455] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dec769302f0d42dd84d2150a08201d99. Latest consensus state: current_term: 1 leader_uuid: "dec769302f0d42dd84d2150a08201d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.970264 17774 sys_catalog.cc:458] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:27.970650 17776 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:57:27.971494 17776 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:57:27.976030 17602 raft_consensus.cc:1261] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [term 1 FOLLOWER]: Refusing update from remote peer dec769302f0d42dd84d2150a08201d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:27.976068 17522 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [term 1 FOLLOWER]: Refusing update from remote peer dec769302f0d42dd84d2150a08201d99: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:27.976752 17774 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:27.976920 17761 consensus_queue.cc:1035] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:27.980876 17738 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [sys.catalog]: SysCatalogTable state changed. Reason: New leader dec769302f0d42dd84d2150a08201d99. Latest consensus state: current_term: 1 leader_uuid: "dec769302f0d42dd84d2150a08201d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.980882 17723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dec769302f0d42dd84d2150a08201d99. Latest consensus state: current_term: 1 leader_uuid: "dec769302f0d42dd84d2150a08201d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.981014 17723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:57:27.981015 17738 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:57:27.983572 17761 sys_catalog.cc:455] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dec769302f0d42dd84d2150a08201d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.983687 17761 sys_catalog.cc:458] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:27.984211 17738 sys_catalog.cc:455] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dec769302f0d42dd84d2150a08201d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.984323 17738 sys_catalog.cc:458] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:57:27.984817 17761 sys_catalog.cc:455] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "dec769302f0d42dd84d2150a08201d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.984929 17761 sys_catalog.cc:458] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:27.985316 17776 catalog_manager.cc:1347] Generated new cluster ID: 695f86bba2b547d6afd13d94602ff166
I20260808 05:57:27.985373 17776 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:57:27.985865 17723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "dec769302f0d42dd84d2150a08201d99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9ca1d1ed0a1d489b8e93186eb2dd0061" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 34487 } } peers { permanent_uuid: "afc10010096e4676b4536e0c3499709b" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 35571 } } peers { permanent_uuid: "dec769302f0d42dd84d2150a08201d99" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 39129 } } }
I20260808 05:57:27.985976 17723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:57:27.986586 17779 mvcc.cc:205] Tried to move back new op lower bound from 7316146782103252992 to 7316146782080290816. Current Snapshot: MvccSnapshot[applied={T|T < 7316146782103252992}]
I20260808 05:57:28.003700 17776 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:57:28.004833 17776 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:57:28.012322 17776 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dec769302f0d42dd84d2150a08201d99: Generated new TSK 0
I20260808 05:57:28.013289 17776 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:57:28.650655 17736 catalog_manager.cc:1259] Loaded cluster ID: 695f86bba2b547d6afd13d94602ff166
I20260808 05:57:28.650791 17736 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: loading cluster ID for follower catalog manager: success
I20260808 05:57:28.652561 17736 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: acquiring CA information for follower catalog manager: success
I20260808 05:57:28.653959 17736 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9ca1d1ed0a1d489b8e93186eb2dd0061: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:57:28.658398 17751 catalog_manager.cc:1259] Loaded cluster ID: 695f86bba2b547d6afd13d94602ff166
I20260808 05:57:28.658470 17751 catalog_manager.cc:1552] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: loading cluster ID for follower catalog manager: success
I20260808 05:57:28.660113 17751 catalog_manager.cc:1574] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: acquiring CA information for follower catalog manager: success
I20260808 05:57:28.661375 17751 catalog_manager.cc:1602] T 00000000000000000000000000000000 P afc10010096e4676b4536e0c3499709b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:57:29.088209 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 17474
I20260808 05:57:29.097121 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 17557
I20260808 05:57:29.105647 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 17637
2026-08-08T05:57:29Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3407 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:57:29 dist-test-slave-qg60 krb5kdc[17793](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:57:29 dist-test-slave-qg60 krb5kdc[17793](info): set up 2 sockets
Aug 08 05:57:29 dist-test-slave-qg60 krb5kdc[17793](info): commencing operation
krb5kdc: starting...
W20260808 05:57:30.224133 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.095s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:57:30 dist-test-slave-qg60 krb5kdc[17793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:57:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:57:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:57:30.360113 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:46665
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:42315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:46665
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:30.489332 17807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:30.489643 17807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:30.489691 17807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:30.493903 17807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:30.493981 17807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:30.494001 17807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:30.494040 17807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:30.494076 17807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:30.499586 17807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:42315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:46665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:46665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:30.500808 17807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:30.501889 17807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:30.511157 17814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:30.511207 17817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:30.511327 17807 server_base.cc:1034] running on GCE node
W20260808 05:57:30.511226 17813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:30.512118 17807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:30.513468 17807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:30.514663 17807 hybrid_clock.cc:648] HybridClock initialized: now 1786168650514648 us; error 29 us; skew 500 ppm
Aug 08 05:57:30 dist-test-slave-qg60 krb5kdc[17793](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168650, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:30.517871 17807 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:57:30.518796 17807 webserver.cc:460] Webserver started at http://127.2.191.126:33227/ using document root <none> and password file <none>
I20260808 05:57:30.519378 17807 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:30.519443 17807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:30.519624 17807 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:30.521965 17807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "cceb9b6413b34ab097b5716aed639165"
format_stamp: "Formatted at 2026-08-08 05:57:30 on dist-test-slave-qg60"
server_key: "d35cb433c54dbcd53ac0fb4391293a24"
server_key_iv: "2f9e5c6913c19778ef5693a7b123f665"
server_key_version: "encryptionkey@0"
I20260808 05:57:30.522583 17807 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "cceb9b6413b34ab097b5716aed639165"
format_stamp: "Formatted at 2026-08-08 05:57:30 on dist-test-slave-qg60"
server_key: "d35cb433c54dbcd53ac0fb4391293a24"
server_key_iv: "2f9e5c6913c19778ef5693a7b123f665"
server_key_version: "encryptionkey@0"
I20260808 05:57:30.526780 17807 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:57:30.529532 17824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:30.530944 17807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 05:57:30.531144 17807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "cceb9b6413b34ab097b5716aed639165"
format_stamp: "Formatted at 2026-08-08 05:57:30 on dist-test-slave-qg60"
server_key: "d35cb433c54dbcd53ac0fb4391293a24"
server_key_iv: "2f9e5c6913c19778ef5693a7b123f665"
server_key_version: "encryptionkey@0"
I20260808 05:57:30.531282 17807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:30.569909 17807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:30.573081 17807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:30.573309 17807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:30.580811 17807 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:46665
I20260808 05:57:30.580839 17878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:46665 every 8 connection(s)
I20260808 05:57:30.581804 17807 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:57:30.584661 17879 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:30.588544 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 17807
I20260808 05:57:30.588682 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:57:30.589016 2813 external_mini_cluster.cc:1428] Setting key f9769e19ef6796ff10ead169bb03100e
I20260808 05:57:30.591209 17879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165: Bootstrap starting.
I20260808 05:57:30.593612 17879 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:30.594385 17879 log.cc:824] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:30.596287 17879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165: No bootstrap required, opened a new log
Aug 08 05:57:30 dist-test-slave-qg60 krb5kdc[17793](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168650, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:30.600682 17879 raft_consensus.cc:348] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cceb9b6413b34ab097b5716aed639165" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46665 } }
I20260808 05:57:30.600972 17879 raft_consensus.cc:374] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:30.601054 17879 raft_consensus.cc:729] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cceb9b6413b34ab097b5716aed639165, State: Initialized, Role: FOLLOWER
I20260808 05:57:30.601578 17879 consensus_queue.cc:260] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cceb9b6413b34ab097b5716aed639165" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46665 } }
I20260808 05:57:30.601717 17879 raft_consensus.cc:388] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:57:30.601794 17879 raft_consensus.cc:482] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:57:30.601897 17879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:30.602931 17879 raft_consensus.cc:504] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cceb9b6413b34ab097b5716aed639165" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46665 } }
I20260808 05:57:30.603314 17879 leader_election.cc:302] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cceb9b6413b34ab097b5716aed639165; no voters:
I20260808 05:57:30.603675 17879 leader_election.cc:288] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:57:30.603785 17886 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:30.604032 17886 raft_consensus.cc:686] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [term 1 LEADER]: Becoming Leader. State: Replica: cceb9b6413b34ab097b5716aed639165, State: Running, Role: LEADER
I20260808 05:57:30.604391 17886 consensus_queue.cc:237] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cceb9b6413b34ab097b5716aed639165" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46665 } }
I20260808 05:57:30.604874 17883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:30.590496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53250 (local address 127.2.191.126:46665)
0808 05:57:30.590952 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:30.590968 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:30.591007 (+ 39us) server_negotiation.cc:407] Connection header received
0808 05:57:30.591750 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:30.591771 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:30.592127 (+ 356us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:30.592499 (+ 372us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:30.593411 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:30.594520 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:30.595402 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:30.595883 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:30.596058 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:30.598873 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:30.598880 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:30.598899 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:30.598945 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:30.600953 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:30.601599 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:30.601605 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:30.601628 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:30.601898 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:30.602280 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:30.602283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:30.602284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:30.602744 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:30.602931 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:30.603282 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 05:57:30.603696 (+ 414us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":139,"threads_started":1}
I20260808 05:57:30.604977 17879 sys_catalog.cc:564] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:30.606177 17888 sys_catalog.cc:455] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cceb9b6413b34ab097b5716aed639165" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cceb9b6413b34ab097b5716aed639165" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46665 } } }
I20260808 05:57:30.606323 17888 sys_catalog.cc:458] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:30.606571 17888 sys_catalog.cc:455] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cceb9b6413b34ab097b5716aed639165. Latest consensus state: current_term: 1 leader_uuid: "cceb9b6413b34ab097b5716aed639165" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cceb9b6413b34ab097b5716aed639165" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 46665 } } }
I20260808 05:57:30.606665 17888 sys_catalog.cc:458] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:30.607059 17896 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:57:30.608636 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:57:30.610778 17896 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:57:30.616860 17896 catalog_manager.cc:1347] Generated new cluster ID: 5212086ce52f449ab2dd990ac5839a59
I20260808 05:57:30.616950 17896 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:57:30.638815 17896 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:57:30.640141 17896 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:57:30.647136 17896 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cceb9b6413b34ab097b5716aed639165: Generated new TSK 0
I20260808 05:57:30.647877 17896 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:57:30.664944 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 17807
2026-08-08T05:57:30Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1557 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:57:30 dist-test-slave-qg60 krb5kdc[17911](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:57:30 dist-test-slave-qg60 krb5kdc[17911](info): set up 2 sockets
Aug 08 05:57:30 dist-test-slave-qg60 krb5kdc[17911](info): commencing operation
krb5kdc: starting...
W20260808 05:57:31.815237 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:57:31 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:57:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:57:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:57:31.951920 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44283
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:44283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:32.068238 17924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:32.068614 17924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:32.068692 17924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:32.072765 17924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:32.072854 17924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:32.072892 17924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:32.072930 17924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:32.072964 17924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:32.078742 17924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:44283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:32.079806 17924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:32.080847 17924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:32.089596 17930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:32.089591 17933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:32.089629 17931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:32.089895 17924 server_base.cc:1034] running on GCE node
I20260808 05:57:32.090525 17924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:32.091661 17924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:32.092810 17924 hybrid_clock.cc:648] HybridClock initialized: now 1786168652092799 us; error 30 us; skew 500 ppm
Aug 08 05:57:32 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168652, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:32.101020 17924 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:57:32.102056 17924 webserver.cc:460] Webserver started at http://127.2.191.126:45337/ using document root <none> and password file <none>
I20260808 05:57:32.102634 17924 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:32.102700 17924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:32.102885 17924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:32.105264 17924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "10a60cf80b6b476b96bd46b4c97b7ac1"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "65eecfc0d383de312a9b2331064886a5"
server_key_iv: "10bd8ef68698b902f791ce62bd3b9afa"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.105870 17924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "10a60cf80b6b476b96bd46b4c97b7ac1"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "65eecfc0d383de312a9b2331064886a5"
server_key_iv: "10bd8ef68698b902f791ce62bd3b9afa"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.110219 17924 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:57:32.112887 17940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.114233 17924 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:57:32.114377 17924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "10a60cf80b6b476b96bd46b4c97b7ac1"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "65eecfc0d383de312a9b2331064886a5"
server_key_iv: "10bd8ef68698b902f791ce62bd3b9afa"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.114494 17924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:32.127919 17924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:32.131826 17924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:32.132055 17924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:32.140208 17924 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:44283
I20260808 05:57:32.140537 17994 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:44283 every 8 connection(s)
I20260808 05:57:32.141340 17924 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:57:32.144352 17996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:32.149802 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 17924
I20260808 05:57:32.149956 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:57:32.150288 2813 external_mini_cluster.cc:1428] Setting key 4fc4e5eaf9a9f41b00b1091b2c62ac8f
I20260808 05:57:32.151292 17996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Bootstrap starting.
I20260808 05:57:32.153815 17996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:32.154579 17996 log.cc:824] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:32.156589 17996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: No bootstrap required, opened a new log
Aug 08 05:57:32 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:32.160550 17996 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:32.160861 17996 raft_consensus.cc:374] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:32.160924 17996 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a60cf80b6b476b96bd46b4c97b7ac1, State: Initialized, Role: FOLLOWER
I20260808 05:57:32.161375 17996 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:32.161494 17996 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:57:32.161605 17996 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:57:32.161724 17996 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:32.163062 17996 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:32.163470 17996 leader_election.cc:302] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10a60cf80b6b476b96bd46b4c97b7ac1; no voters:
I20260808 05:57:32.163841 17996 leader_election.cc:288] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:57:32.164001 18001 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:32.164255 18001 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 1 LEADER]: Becoming Leader. State: Replica: 10a60cf80b6b476b96bd46b4c97b7ac1, State: Running, Role: LEADER
I20260808 05:57:32.164595 18001 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:32.165174 17996 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:32.166347 18002 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } } }
I20260808 05:57:32.166476 18002 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:32.166715 18002 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10a60cf80b6b476b96bd46b4c97b7ac1. Latest consensus state: current_term: 1 leader_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } } }
I20260808 05:57:32.166798 18002 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:32.167075 18011 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:57:32.167179 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.151878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33942 (local address 127.2.191.126:44283)
0808 05:57:32.152493 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:32.152510 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:32.152558 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:57:32.153447 (+ 889us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:32.153467 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:32.154070 (+ 603us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:32.154493 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:32.155427 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.156466 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.157440 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.157914 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.158086 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.161040 (+ 2954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:32.161050 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:32.161065 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:32.161097 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:32.163286 (+ 2189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.163816 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.163823 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.163829 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.164001 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.164477 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.164480 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.164482 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.165047 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:32.165224 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:32.165751 (+ 527us) server_negotiation.cc:299] Negotiation successful
0808 05:57:32.166086 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":270,"threads_started":1}
I20260808 05:57:32.170183 18011 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:57:32.175896 18011 catalog_manager.cc:1347] Generated new cluster ID: abaa5c619aca4439b5df2ae71e7accc7
I20260808 05:57:32.175978 18011 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:57:32.181437 18011 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:57:32.182339 18011 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:57:32.193388 18011 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Generated new TSK 0
I20260808 05:57:32.194308 18011 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:57:32.234018 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44283
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:32.349021 18024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:32.349371 18024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:32.349448 18024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:32.353677 18024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:32.353775 18024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:32.353870 18024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:57:32.359385 18024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:32.360623 18024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:32.361804 18024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:32.371977 18032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:32.371990 18030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:32.372013 18029 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:32.372537 18024 server_base.cc:1034] running on GCE node
I20260808 05:57:32.373015 18024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:32.373694 18024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:32.374887 18024 hybrid_clock.cc:648] HybridClock initialized: now 1786168652374864 us; error 35 us; skew 500 ppm
Aug 08 05:57:32 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168652, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:32.377931 18024 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:57:32.378935 18024 webserver.cc:460] Webserver started at http://127.2.191.65:44463/ using document root <none> and password file <none>
I20260808 05:57:32.379531 18024 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:32.379626 18024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:32.379868 18024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:32.382165 18024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "d924f4d80f924cdba4b5d368296f8bae"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5bf5282ef1d90705e2e1d0a445cd22df"
server_key_iv: "7cf2b2b6eb1563ef1f6242e1e954ddae"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.382763 18024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "d924f4d80f924cdba4b5d368296f8bae"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5bf5282ef1d90705e2e1d0a445cd22df"
server_key_iv: "7cf2b2b6eb1563ef1f6242e1e954ddae"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.386641 18024 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 05:57:32.389202 18039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.390444 18024 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:57:32.390580 18024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "d924f4d80f924cdba4b5d368296f8bae"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5bf5282ef1d90705e2e1d0a445cd22df"
server_key_iv: "7cf2b2b6eb1563ef1f6242e1e954ddae"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.390703 18024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:32.410084 18024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:32.413673 18024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:32.413895 18024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:32.414520 18024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:32.415380 18024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:32.415450 18024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.415530 18024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:32.415575 18024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.425470 18024 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:38691
I20260808 05:57:32.425490 18160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:38691 every 8 connection(s)
I20260808 05:57:32.426455 18024 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:57:32.432220 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 18024
I20260808 05:57:32.432368 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:57:32.432649 2813 external_mini_cluster.cc:1428] Setting key 71df0204dbf32d2fc8cbfa8e6fe708f5
Aug 08 05:57:32 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168652, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:32.441776 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.428500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:49573 (local address 127.2.191.126:44283)
0808 05:57:32.428649 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:32.428653 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:32.429537 (+ 884us) server_negotiation.cc:407] Connection header received
0808 05:57:32.430841 (+ 1304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:32.430845 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:32.430906 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:32.430992 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:32.432252 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.432974 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.434418 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.434663 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.434774 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.437526 (+ 2752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:32.437529 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:32.437531 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:32.437589 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:32.439319 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.439900 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.439907 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.439912 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.440023 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.440376 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.440380 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.440384 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.440657 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:32.440804 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:32.441353 (+ 549us) server_negotiation.cc:299] Negotiation successful
0808 05:57:32.441515 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 05:57:32.442533 18163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.428908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:49573)
0808 05:57:32.429385 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:32.429431 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:32.430630 (+ 1199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:32.431181 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:32.431188 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:32.431567 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:32.432088 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.432105 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.433148 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.433151 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.434292 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.434302 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.434821 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.434825 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.434999 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.435669 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:32.435686 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:32.437336 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:32.439453 (+ 2117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:32.439459 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:32.439473 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:32.439773 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:32.440133 (+ 360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:32.440135 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:32.440137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:32.440277 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:32.440823 (+ 546us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:32.440828 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:32.441093 (+ 265us) client_negotiation.cc:769] Sending connection context
0808 05:57:32.441262 (+ 169us) client_negotiation.cc:240] Negotiation successful
0808 05:57:32.441545 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"thread_start_us":125,"threads_started":1}
I20260808 05:57:32.443936 18161 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44283
I20260808 05:57:32.444252 18161 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:57:32.444934 18161 heartbeater.cc:511] Master 127.2.191.126:44283 requested a full tablet report, sending...
I20260808 05:57:32.446834 17959 ts_manager.cc:194] Registered new tserver with Master: d924f4d80f924cdba4b5d368296f8bae (127.2.191.65:38691)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:57:32.448345 17959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:49573
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:57:32.466428 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44283
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:32.585394 18167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:32.585726 18167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:32.585804 18167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:32.589915 18167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:32.590034 18167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:32.590135 18167 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:57:32.595754 18167 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:32.597018 18167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:32.598186 18167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:32.608561 18175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:32.608580 18173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:32.608580 18172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:32.608978 18167 server_base.cc:1034] running on GCE node
I20260808 05:57:32.609370 18167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:32.610000 18167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:32.611166 18167 hybrid_clock.cc:648] HybridClock initialized: now 1786168652611146 us; error 33 us; skew 500 ppm
Aug 08 05:57:32 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168652, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:32.614215 18167 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:57:32.615177 18167 webserver.cc:460] Webserver started at http://127.2.191.66:38415/ using document root <none> and password file <none>
I20260808 05:57:32.615763 18167 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:32.615830 18167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:32.616077 18167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:32.618258 18167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "5689ee6bf4c446d4991c1f6e39c53b38"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "53aaed4904b148aa03fd48c6c352e4cb"
server_key_iv: "3cfb5a0f3f5858550ce247d10bbc874f"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.618893 18167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "5689ee6bf4c446d4991c1f6e39c53b38"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "53aaed4904b148aa03fd48c6c352e4cb"
server_key_iv: "3cfb5a0f3f5858550ce247d10bbc874f"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.623062 18167 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:57:32.625787 18182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.627074 18167 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:57:32.627233 18167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "5689ee6bf4c446d4991c1f6e39c53b38"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "53aaed4904b148aa03fd48c6c352e4cb"
server_key_iv: "3cfb5a0f3f5858550ce247d10bbc874f"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.627353 18167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:32.640738 18167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:32.643806 18167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:32.644013 18167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:32.644680 18167 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:32.645622 18167 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:32.645673 18167 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.645740 18167 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:32.645771 18167 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.654971 18167 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:34581
I20260808 05:57:32.654994 18304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:34581 every 8 connection(s)
I20260808 05:57:32.655929 18167 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:57:32.665270 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 18167
I20260808 05:57:32.665381 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
Aug 08 05:57:32 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168652, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:32.665712 2813 external_mini_cluster.cc:1428] Setting key 7980c7632e9b628029d762ece978cee1
I20260808 05:57:32.671205 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.657835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:41419 (local address 127.2.191.126:44283)
0808 05:57:32.657981 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:32.657984 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:32.658833 (+ 849us) server_negotiation.cc:407] Connection header received
0808 05:57:32.660151 (+ 1318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:32.660154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:32.660202 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:32.660284 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:32.661519 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.662094 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.663207 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.663442 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.663543 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.666424 (+ 2881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:32.666428 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:32.666430 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:32.666460 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:32.668487 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.669200 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.669206 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.669211 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.669314 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.669745 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.669751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.669755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.670031 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:32.670136 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:32.670877 (+ 741us) server_negotiation.cc:299] Negotiation successful
0808 05:57:32.671014 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:57:32.672039 18307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.658234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:41419)
0808 05:57:32.658676 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:32.658721 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:32.659877 (+ 1156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:32.660442 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:32.660449 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:32.660896 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:32.661385 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.661398 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.662202 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.662204 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.663073 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.663082 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.663606 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.663609 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.663760 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.664385 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:32.664401 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:32.666210 (+ 1809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:32.668634 (+ 2424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:32.668643 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:32.668662 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:32.669076 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:32.669409 (+ 333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:32.669415 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:32.669419 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:32.669611 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:32.670220 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:32.670230 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:32.670615 (+ 385us) client_negotiation.cc:769] Sending connection context
0808 05:57:32.670813 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 05:57:32.671161 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":117,"threads_started":1}
I20260808 05:57:32.673327 18305 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44283
I20260808 05:57:32.673601 18305 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:32.674115 18305 heartbeater.cc:511] Master 127.2.191.126:44283 requested a full tablet report, sending...
I20260808 05:57:32.675216 17959 ts_manager.cc:194] Registered new tserver with Master: 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
I20260808 05:57:32.675803 17959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:41419
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:57:32.696525 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44283
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:32.816824 18310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:32.817112 18310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:32.817160 18310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:32.821507 18310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:32.821578 18310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:32.821656 18310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:57:32.827253 18310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:32.828415 18310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:32.829536 18310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:32.839944 18315 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:32.839936 18316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:32.839936 18318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:32.840422 18310 server_base.cc:1034] running on GCE node
I20260808 05:57:32.840931 18310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:32.841660 18310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:32.842876 18310 hybrid_clock.cc:648] HybridClock initialized: now 1786168652842821 us; error 67 us; skew 500 ppm
Aug 08 05:57:32 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168652, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:32.846117 18310 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:57:32.847076 18310 webserver.cc:460] Webserver started at http://127.2.191.67:40203/ using document root <none> and password file <none>
I20260808 05:57:32.847718 18310 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:32.847787 18310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:32.848039 18310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:32.850425 18310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "eb8359ef71f540cdaefd35b733eb3220"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5b5daefaa1a2ec313d7ae137f0b3b8c9"
server_key_iv: "6363fb51fd826fa4b48ec26653942be7"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.851081 18310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "eb8359ef71f540cdaefd35b733eb3220"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5b5daefaa1a2ec313d7ae137f0b3b8c9"
server_key_iv: "6363fb51fd826fa4b48ec26653942be7"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.855314 18310 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 05:57:32.858247 18327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.859635 18310 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:57:32.859787 18310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "eb8359ef71f540cdaefd35b733eb3220"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5b5daefaa1a2ec313d7ae137f0b3b8c9"
server_key_iv: "6363fb51fd826fa4b48ec26653942be7"
server_key_version: "encryptionkey@0"
I20260808 05:57:32.859920 18310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:32.871447 18310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:32.875084 18310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:32.875324 18310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:32.875967 18310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:32.876907 18310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:32.876983 18310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.877058 18310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:32.877120 18310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:32.886616 18310 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:41953
I20260808 05:57:32.886657 18449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:41953 every 8 connection(s)
I20260808 05:57:32.887622 18310 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:57:32.894538 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 18310
I20260808 05:57:32.894734 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:57:32.895083 2813 external_mini_cluster.cc:1428] Setting key 717784d08b88c61b1750cb1dda9992e3
Aug 08 05:57:32 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168652, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:32.902567 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.889609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:50135 (local address 127.2.191.126:44283)
0808 05:57:32.889759 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:32.889763 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:32.891180 (+ 1417us) server_negotiation.cc:407] Connection header received
0808 05:57:32.892080 (+ 900us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:32.892084 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:32.892143 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:32.892249 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:32.893515 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.894105 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.895522 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.895857 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.895992 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.898884 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:32.898887 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:32.898889 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:32.898916 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:32.900654 (+ 1738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.901164 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.901166 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.901168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.901249 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.901554 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.901557 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.901558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.901749 (+ 191us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:32.901836 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:32.902332 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 05:57:32.902441 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 05:57:32.903352 18452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.890063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:50135)
0808 05:57:32.891001 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:32.891046 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:32.891875 (+ 829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:32.892416 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:32.892422 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:32.892850 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:32.893357 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.893371 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.894252 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.894255 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.895370 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.895380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.896023 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.896026 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.896240 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.897006 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:32.897028 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:32.898700 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:32.900804 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:32.900814 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:32.900826 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:32.901077 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:32.901331 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:32.901333 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:32.901335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:32.901463 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:32.901841 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:32.901846 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:32.902077 (+ 231us) client_negotiation.cc:769] Sending connection context
0808 05:57:32.902226 (+ 149us) client_negotiation.cc:240] Negotiation successful
0808 05:57:32.902476 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":756,"thread_start_us":607,"threads_started":1}
I20260808 05:57:32.904477 18450 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44283
I20260808 05:57:32.904688 18450 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:32.905215 18450 heartbeater.cc:511] Master 127.2.191.126:44283 requested a full tablet report, sending...
I20260808 05:57:32.906309 17959 ts_manager.cc:194] Registered new tserver with Master: eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953)
I20260808 05:57:32.906872 17959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:50135
I20260808 05:57:32.909438 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:57:32.921734 17999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.911742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33950 (local address 127.2.191.126:44283)
0808 05:57:32.911943 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:32.911948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:32.912190 (+ 242us) server_negotiation.cc:407] Connection header received
0808 05:57:32.912244 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:32.912248 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:32.912305 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:32.912472 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:32.913448 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.914167 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.915015 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.915245 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.915350 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.916991 (+ 1641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:32.916996 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:32.916999 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:32.917027 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:32.919083 (+ 2056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.919592 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.919599 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.919602 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.919703 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:32.920172 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:32.920177 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:32.920180 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:32.920561 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:32.920787 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:32.921453 (+ 666us) server_negotiation.cc:299] Negotiation successful
0808 05:57:32.921589 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 05:57:32.925239 17959 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:57:32.928448 17959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:57:32.943588 18462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.937382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34581 (local address 127.0.0.1:48278)
0808 05:57:32.938313 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:32.938367 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:32.938542 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:32.939266 (+ 724us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:32.939272 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:32.939294 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:32.939468 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.939477 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.940552 (+ 1075us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.940557 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.941879 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.941889 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.942777 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.942781 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.942888 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.942929 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 05:57:32.943250 (+ 321us) client_negotiation.cc:240] Negotiation successful
0808 05:57:32.943380 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":749,"mutex_wait_us":55,"thread_start_us":119,"threads_started":1}
I20260808 05:57:32.943588 18464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.937534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48278 (local address 127.2.191.66:34581)
0808 05:57:32.937888 (+ 354us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:32.937904 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:32.938700 (+ 796us) server_negotiation.cc:407] Connection header received
0808 05:57:32.938792 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:32.938798 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:32.939102 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:32.939276 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:32.939607 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.940415 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.942018 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.942655 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.942768 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.942923 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:32.943298 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 05:57:32.943420 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":240,"thread_start_us":117,"threads_started":1}
I20260808 05:57:32.944144 18465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.938185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:38691 (local address 127.0.0.1:39122)
0808 05:57:32.938973 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:32.938987 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:32.939074 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:32.939486 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:32.939489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:32.939510 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:32.939606 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.939611 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.941093 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.941096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.942483 (+ 1387us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.942494 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.943731 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.943738 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.943826 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.943844 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 05:57:32.943933 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:57:32.944004 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"mutex_wait_us":186,"thread_start_us":91,"threads_started":1}
I20260808 05:57:32.944190 18467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.938635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39122 (local address 127.2.191.65:38691)
0808 05:57:32.939053 (+ 418us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:32.939083 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:32.939106 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:57:32.939183 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:32.939190 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:32.939352 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:32.939500 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:32.939722 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.940924 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.942622 (+ 1698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.943434 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.943531 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.943667 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:32.943968 (+ 301us) server_negotiation.cc:299] Negotiation successful
0808 05:57:32.944060 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":77,"threads_started":1}
I20260808 05:57:32.944759 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.937452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41953 (local address 127.0.0.1:34076)
0808 05:57:32.938693 (+ 1241us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:32.938709 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:32.938802 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:32.939448 (+ 646us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:32.939454 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:32.939474 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:32.939604 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.939611 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.941093 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.941096 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.942426 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:32.942437 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.944042 (+ 1605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.944046 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:32.944141 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.944166 (+ 25us) client_negotiation.cc:769] Sending connection context
0808 05:57:32.944507 (+ 341us) client_negotiation.cc:240] Negotiation successful
0808 05:57:32.944583 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1172,"mutex_wait_us":41,"spinlock_wait_cycles":896,"thread_start_us":105,"threads_started":1}
I20260808 05:57:32.944784 18466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:32.938283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34076 (local address 127.2.191.67:41953)
0808 05:57:32.938795 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:32.938808 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:32.938831 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:57:32.938914 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:32.938919 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:32.939119 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:32.939273 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:32.939767 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.940950 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.942564 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:32.943358 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:32.943460 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:32.943600 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:32.944539 (+ 939us) server_negotiation.cc:299] Negotiation successful
0808 05:57:32.944621 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":404,"thread_start_us":137,"threads_started":1}
I20260808 05:57:32.946877 18234 tablet_service.cc:1467] Processing CreateTablet for tablet 9b7a50c71a244bbca0a72739202ed95b (DEFAULT_TABLE table=test-table [id=1c24c5673c7140c3955896f09c9208c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:32.947881 18234 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b7a50c71a244bbca0a72739202ed95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:32.947805 18378 tablet_service.cc:1467] Processing CreateTablet for tablet 9b7a50c71a244bbca0a72739202ed95b (DEFAULT_TABLE table=test-table [id=1c24c5673c7140c3955896f09c9208c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:32.947803 18094 tablet_service.cc:1467] Processing CreateTablet for tablet 9b7a50c71a244bbca0a72739202ed95b (DEFAULT_TABLE table=test-table [id=1c24c5673c7140c3955896f09c9208c3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:32.948907 18378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b7a50c71a244bbca0a72739202ed95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:32.948899 18094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9b7a50c71a244bbca0a72739202ed95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:32.954686 18468 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Bootstrap starting.
I20260808 05:57:32.956494 18470 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Bootstrap starting.
I20260808 05:57:32.957078 18469 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Bootstrap starting.
I20260808 05:57:32.957324 18468 tablet_bootstrap.cc:654] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:32.958079 18468 log.cc:824] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:32.959254 18470 tablet_bootstrap.cc:654] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:32.959254 18469 tablet_bootstrap.cc:654] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:32.960135 18469 log.cc:824] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:32.960135 18470 log.cc:824] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:32.960248 18468 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: No bootstrap required, opened a new log
I20260808 05:57:32.960443 18468 ts_tablet_manager.cc:1397] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 05:57:32.962237 18470 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: No bootstrap required, opened a new log
I20260808 05:57:32.962236 18469 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: No bootstrap required, opened a new log
I20260808 05:57:32.962435 18470 ts_tablet_manager.cc:1397] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:57:32.962435 18469 ts_tablet_manager.cc:1397] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:57:32.963739 18468 raft_consensus.cc:348] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:32.963994 18468 raft_consensus.cc:374] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:32.964071 18468 raft_consensus.cc:729] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5689ee6bf4c446d4991c1f6e39c53b38, State: Initialized, Role: FOLLOWER
I20260808 05:57:32.964551 18468 consensus_queue.cc:260] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:32.965287 18305 heartbeater.cc:503] Master 127.2.191.126:44283 was elected leader, sending a full tablet report...
I20260808 05:57:32.965687 18468 ts_tablet_manager.cc:1428] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Time spent starting tablet: real 0.005s user 0.005s sys 0.002s
I20260808 05:57:32.966907 18469 raft_consensus.cc:348] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:32.967214 18470 raft_consensus.cc:348] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:32.967496 18469 raft_consensus.cc:374] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:32.967500 18470 raft_consensus.cc:374] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:32.967563 18469 raft_consensus.cc:729] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d924f4d80f924cdba4b5d368296f8bae, State: Initialized, Role: FOLLOWER
I20260808 05:57:32.967574 18470 raft_consensus.cc:729] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8359ef71f540cdaefd35b733eb3220, State: Initialized, Role: FOLLOWER
I20260808 05:57:32.968003 18470 consensus_queue.cc:260] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:32.968046 18469 consensus_queue.cc:260] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:32.968649 18450 heartbeater.cc:503] Master 127.2.191.126:44283 was elected leader, sending a full tablet report...
I20260808 05:57:32.969122 18469 ts_tablet_manager.cc:1428] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20260808 05:57:32.969471 18161 heartbeater.cc:503] Master 127.2.191.126:44283 was elected leader, sending a full tablet report...
I20260808 05:57:32.970278 18470 ts_tablet_manager.cc:1428] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
W20260808 05:57:33.138698 18451 tablet.cc:2369] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:57:33.157122 18306 tablet.cc:2369] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:57:33.168996 18478 raft_consensus.cc:482] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:33.169278 18478 raft_consensus.cc:504] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:33.170544 18478 leader_election.cc:288] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581), eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953)
I20260808 05:57:33.175010 18479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.170779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34581 (local address 127.2.191.65:48615)
0808 05:57:33.171159 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:33.171178 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:33.171374 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:33.171786 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:33.171788 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:33.171802 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:33.171935 (+ 133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.171941 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.172893 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.172896 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.173845 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.173855 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.174519 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.174522 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.174669 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.174689 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 05:57:33.174753 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:57:33.174812 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"mutex_wait_us":43,"spinlock_wait_cycles":81024,"thread_start_us":108,"threads_started":1}
I20260808 05:57:33.175060 18464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.170891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:48615 (local address 127.2.191.66:34581)
0808 05:57:33.171044 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:33.171050 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:33.171267 (+ 217us) server_negotiation.cc:407] Connection header received
0808 05:57:33.171526 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:33.171529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:33.171601 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:33.171671 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:33.172057 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.172783 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.173974 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.174387 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.174517 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.174573 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:33.174816 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 05:57:33.174921 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:57:33.175134 18466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.170985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:58209 (local address 127.2.191.67:41953)
0808 05:57:33.171112 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:33.171116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:33.171289 (+ 173us) server_negotiation.cc:407] Connection header received
0808 05:57:33.171472 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:33.171476 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:33.171531 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:33.171606 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:33.171956 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.172765 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.173971 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.174388 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.174517 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.174573 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:33.174927 (+ 354us) server_negotiation.cc:299] Negotiation successful
0808 05:57:33.175002 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:57:33.175678 18480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.170855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41953 (local address 127.2.191.65:58209)
0808 05:57:33.171193 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:33.171205 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:33.171353 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:33.171653 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:33.171656 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:33.171682 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:33.171827 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.171834 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.172875 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.172881 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.173846 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.173856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.174518 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.174521 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.174722 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.174784 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 05:57:33.174883 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 05:57:33.174954 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":270,"mutex_wait_us":96,"spinlock_wait_cycles":1408,"thread_start_us":126,"threads_started":1}
I20260808 05:57:33.175925 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b7a50c71a244bbca0a72739202ed95b" candidate_uuid: "d924f4d80f924cdba4b5d368296f8bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" is_pre_election: true
I20260808 05:57:33.176292 18254 raft_consensus.cc:2454] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d924f4d80f924cdba4b5d368296f8bae in term 0.
I20260808 05:57:33.176436 18402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b7a50c71a244bbca0a72739202ed95b" candidate_uuid: "d924f4d80f924cdba4b5d368296f8bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb8359ef71f540cdaefd35b733eb3220" is_pre_election: true
I20260808 05:57:33.176800 18402 raft_consensus.cc:2454] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d924f4d80f924cdba4b5d368296f8bae in term 0.
I20260808 05:57:33.176883 18043 leader_election.cc:302] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5689ee6bf4c446d4991c1f6e39c53b38, d924f4d80f924cdba4b5d368296f8bae; no voters:
I20260808 05:57:33.177206 18478 raft_consensus.cc:2781] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:57:33.177310 18478 raft_consensus.cc:482] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:57:33.177371 18478 raft_consensus.cc:3037] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Advancing to term 1
W20260808 05:57:33.177750 18162 tablet.cc:2369] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:57:33.178529 18478 raft_consensus.cc:504] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:33.178900 18478 leader_election.cc:288] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 1 election: Requested vote from peers 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581), eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953)
I20260808 05:57:33.179380 18254 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b7a50c71a244bbca0a72739202ed95b" candidate_uuid: "d924f4d80f924cdba4b5d368296f8bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5689ee6bf4c446d4991c1f6e39c53b38"
I20260808 05:57:33.179513 18402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9b7a50c71a244bbca0a72739202ed95b" candidate_uuid: "d924f4d80f924cdba4b5d368296f8bae" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb8359ef71f540cdaefd35b733eb3220"
I20260808 05:57:33.179529 18254 raft_consensus.cc:3037] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:33.179641 18402 raft_consensus.cc:3037] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:33.180631 18254 raft_consensus.cc:2454] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d924f4d80f924cdba4b5d368296f8bae in term 1.
I20260808 05:57:33.180823 18402 raft_consensus.cc:2454] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d924f4d80f924cdba4b5d368296f8bae in term 1.
I20260808 05:57:33.180972 18043 leader_election.cc:302] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5689ee6bf4c446d4991c1f6e39c53b38, d924f4d80f924cdba4b5d368296f8bae; no voters:
I20260808 05:57:33.181205 18478 raft_consensus.cc:2781] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:33.181406 18478 raft_consensus.cc:686] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 1 LEADER]: Becoming Leader. State: Replica: d924f4d80f924cdba4b5d368296f8bae, State: Running, Role: LEADER
I20260808 05:57:33.181766 18478 consensus_queue.cc:237] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:33.185384 17958 catalog_manager.cc:5495] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae reported cstate change: term changed from 0 to 1, leader changed from <none> to d924f4d80f924cdba4b5d368296f8bae (127.2.191.65). New cstate: current_term: 1 leader_uuid: "d924f4d80f924cdba4b5d368296f8bae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } health_report { overall_health: HEALTHY } } }
I20260808 05:57:33.238168 18467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.234682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39124 (local address 127.2.191.65:38691)
0808 05:57:33.234821 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:33.234825 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:33.234840 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:57:33.234962 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:33.234965 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:33.235019 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:33.235122 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:57:33.235338 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.235860 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.236764 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.236979 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.237063 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.237345 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:57:33.237785 (+ 440us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:57:33.237881 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:33.237934 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 05:57:33.237985 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:57:33.244067 18402 raft_consensus.cc:1261] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 1 FOLLOWER]: Refusing update from remote peer d924f4d80f924cdba4b5d368296f8bae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:33.244065 18254 raft_consensus.cc:1261] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Refusing update from remote peer d924f4d80f924cdba4b5d368296f8bae: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:33.244848 18478 consensus_queue.cc:1035] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:33.245079 18481 consensus_queue.cc:1035] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [LEADER]: Connected to new peer: Peer: permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:33.252991 18486 mvcc.cc:205] Tried to move back new op lower bound from 7316146803680579584 to 7316146803435323392. Current Snapshot: MvccSnapshot[applied={T|T < 7316146803680579584}]
I20260808 05:57:33.261742 17959 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:57:33.261897 17959 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:57:33.264451 17959 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Sending DeleteTablet for 3 replicas of tablet 9b7a50c71a244bbca0a72739202ed95b
I20260808 05:57:33.265326 18094 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b7a50c71a244bbca0a72739202ed95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:33 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:39122
I20260808 05:57:33.265326 18378 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b7a50c71a244bbca0a72739202ed95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:33 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:34076
I20260808 05:57:33.265458 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 18024
I20260808 05:57:33.265512 18234 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b7a50c71a244bbca0a72739202ed95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:33 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:48278
I20260808 05:57:33.273021 18495 tablet_replica.cc:330] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: stopping tablet replica
I20260808 05:57:33.273406 18494 tablet_replica.cc:330] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: stopping tablet replica
I20260808 05:57:33.273533 18495 raft_consensus.cc:2229] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:57:33.273738 18494 raft_consensus.cc:2229] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:57:33.273957 18495 raft_consensus.cc:2258] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:33.273998 18494 raft_consensus.cc:2258] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 05:57:33.275107 17943 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:38691 (error 108)
I20260808 05:57:33.275574 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 18167
I20260808 05:57:33.276153 18494 ts_tablet_manager.cc:1905] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:33.279008 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.278583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:38691 (local address 127.0.0.1:39128)
0808 05:57:33.278774 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:33.278875 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:38691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 05:57:33.279259 17943 catalog_manager.cc:4584] TS d924f4d80f924cdba4b5d368296f8bae (127.2.191.65:38691): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9b7a50c71a244bbca0a72739202ed95b: Network error: Client connection negotiation failed: client connection to 127.2.191.65:38691: connect: Connection refused (error 111)
I20260808 05:57:33.279347 18494 ts_tablet_manager.cc:1918] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:33.279443 18494 log.cc:1196] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/9b7a50c71a244bbca0a72739202ed95b
I20260808 05:57:33.279750 18494 ts_tablet_manager.cc:1939] T 9b7a50c71a244bbca0a72739202ed95b P eb8359ef71f540cdaefd35b733eb3220: Deleting consensus metadata
I20260808 05:57:33.281066 17942 catalog_manager.cc:4841] TS eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953): tablet 9b7a50c71a244bbca0a72739202ed95b (table test-table [id=1c24c5673c7140c3955896f09c9208c3]) successfully deleted
I20260808 05:57:33.284896 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 18310
I20260808 05:57:33.292366 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.285236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34581 (local address 127.0.0.1:48280)
0808 05:57:33.292130 (+ 6894us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:33.292235 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.66:34581: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6752}
I20260808 05:57:33.297276 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 17924
I20260808 05:57:33.306037 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44283
--webserver_interface=127.2.191.126
--webserver_port=45337
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:44283
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:33.424250 18497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:33.424556 18497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:33.424659 18497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:33.429271 18497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:33.429370 18497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:33.429391 18497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:33.429409 18497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:33.429425 18497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:33.435490 18497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:44283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=45337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:33.436770 18497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:33.437878 18497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:33.453513 18504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:33.453679 18497 server_base.cc:1034] running on GCE node
W20260808 05:57:33.453510 18506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:33.453478 18503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:33.454496 18497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:33.455765 18497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:33.456960 18497 hybrid_clock.cc:648] HybridClock initialized: now 1786168653456920 us; error 50 us; skew 500 ppm
Aug 08 05:57:33 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168653, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:33.460119 18497 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:57:33.461280 18497 webserver.cc:460] Webserver started at http://127.2.191.126:45337/ using document root <none> and password file <none>
I20260808 05:57:33.461949 18497 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:33.462083 18497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:33.466379 18497 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:57:33.468757 18513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:33.470121 18497 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:57:33.470377 18497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "10a60cf80b6b476b96bd46b4c97b7ac1"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "65eecfc0d383de312a9b2331064886a5"
server_key_iv: "10bd8ef68698b902f791ce62bd3b9afa"
server_key_version: "encryptionkey@0"
I20260808 05:57:33.471127 18497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:33.491050 18497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:33.494454 18497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:33.494694 18497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:33.502228 18497 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:44283
I20260808 05:57:33.502573 18567 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:44283 every 8 connection(s)
I20260808 05:57:33.503400 18497 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:57:33.503716 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 18497
I20260808 05:57:33.504221 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:38691
--local_ip_for_outbound_sockets=127.2.191.65
--tserver_master_addrs=127.2.191.126:44283
--webserver_port=44463
--webserver_interface=127.2.191.65
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:33.508034 18568 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:57:33.509851 18568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Bootstrap starting.
I20260808 05:57:33.527670 18568 log.cc:824] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:33.537125 18568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:57:33.537536 18568 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Bootstrap complete.
I20260808 05:57:33.541846 18568 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:33.542279 18568 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a60cf80b6b476b96bd46b4c97b7ac1, State: Initialized, Role: FOLLOWER
I20260808 05:57:33.542759 18568 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:33.542901 18568 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:57:33.542991 18568 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:57:33.543112 18568 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:57:33.545109 18568 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:33.545437 18568 leader_election.cc:302] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10a60cf80b6b476b96bd46b4c97b7ac1; no voters:
I20260808 05:57:33.545800 18568 leader_election.cc:288] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:57:33.545873 18572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:57:33.546109 18572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 2 LEADER]: Becoming Leader. State: Replica: 10a60cf80b6b476b96bd46b4c97b7ac1, State: Running, Role: LEADER
I20260808 05:57:33.546403 18572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:33.547096 18568 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:33.547734 18574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } } }
I20260808 05:57:33.547863 18574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:33.548518 18580 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:57:33.548555 18575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10a60cf80b6b476b96bd46b4c97b7ac1. Latest consensus state: current_term: 2 leader_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } } }
I20260808 05:57:33.548678 18575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:33.553968 18580 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:57:33.554687 18580 catalog_manager.cc:1259] Loaded cluster ID: abaa5c619aca4439b5df2ae71e7accc7
I20260808 05:57:33.554757 18580 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:57:33.556113 18580 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 05:57:33.560631 18580 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 05:57:33.566903 18580 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:57:33.567843 18580 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Loaded TSK: 0
I20260808 05:57:33.569164 18580 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:57:33.629334 18570 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:33.629630 18570 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:33.629727 18570 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:33.633908 18570 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:33.633985 18570 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:33.634047 18570 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:57:33.639612 18570 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:38691
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=44463
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18570
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:33.640708 18570 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:33.641805 18570 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:33.651816 18600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:33.651824 18597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:33.651810 18598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:33.652160 18570 server_base.cc:1034] running on GCE node
I20260808 05:57:33.652694 18570 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:33.653443 18570 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:33.654680 18570 hybrid_clock.cc:648] HybridClock initialized: now 1786168653654652 us; error 46 us; skew 500 ppm
Aug 08 05:57:33 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168653, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:33.657935 18570 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:57:33.658989 18570 webserver.cc:460] Webserver started at http://127.2.191.65:44463/ using document root <none> and password file <none>
I20260808 05:57:33.659585 18570 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:33.659699 18570 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:33.663928 18570 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:57:33.666486 18608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:33.668021 18570 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:57:33.668193 18570 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "d924f4d80f924cdba4b5d368296f8bae"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5bf5282ef1d90705e2e1d0a445cd22df"
server_key_iv: "7cf2b2b6eb1563ef1f6242e1e954ddae"
server_key_version: "encryptionkey@0"
I20260808 05:57:33.668864 18570 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:33.692625 18570 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:33.696168 18570 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:33.696394 18570 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:33.697103 18570 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:33.698242 18616 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:57:33.702479 18570 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:57:33.702569 18570 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260808 05:57:33.702648 18570 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:57:33.704407 18570 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:57:33.704474 18570 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 05:57:33.704815 18616 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Bootstrap starting.
I20260808 05:57:33.715253 18570 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:38691
I20260808 05:57:33.715355 18730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:38691 every 8 connection(s)
I20260808 05:57:33.716322 18570 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:57:33.722465 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 18570
I20260808 05:57:33.723016 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:34581
--local_ip_for_outbound_sockets=127.2.191.66
--tserver_master_addrs=127.2.191.126:44283
--webserver_port=38415
--webserver_interface=127.2.191.66
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:33.724382 18616 log.cc:824] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Log is configured to *not* fsync() on all Append() calls
Aug 08 05:57:33 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168653, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:33.733711 18616 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:57:33.734201 18616 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Bootstrap complete.
I20260808 05:57:33.735637 18616 ts_tablet_manager.cc:1397] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.011s
I20260808 05:57:33.737527 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.718580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:55659 (local address 127.2.191.126:44283)
0808 05:57:33.718967 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:33.718988 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:33.719321 (+ 333us) server_negotiation.cc:407] Connection header received
0808 05:57:33.720472 (+ 1151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:33.720483 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:33.720885 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:33.721243 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:33.722504 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.723807 (+ 1303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.725337 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.726174 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.726422 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.730298 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:33.730305 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:33.730322 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:33.730364 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:33.732844 (+ 2480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:33.733695 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:33.733701 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:33.733706 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:33.733929 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:33.734753 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:33.734760 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:33.734765 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:33.735273 (+ 508us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:33.735416 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:33.736224 (+ 808us) server_negotiation.cc:299] Negotiation successful
0808 05:57:33.736563 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":131,"threads_started":1}
I20260808 05:57:33.737727 18734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.718606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:55659)
0808 05:57:33.719152 (+ 546us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:33.719197 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:33.720036 (+ 839us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:33.721309 (+ 1273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:33.721317 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:33.721783 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:33.722309 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.722326 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.724030 (+ 1704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.724034 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.725170 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.725182 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.726373 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.726378 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.726591 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.727535 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:33.727565 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:33.729996 (+ 2431us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:33.733038 (+ 3042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:33.733048 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:33.733067 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:33.733538 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:33.734059 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:33.734064 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:33.734068 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:33.734293 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:33.735420 (+ 1127us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:33.735430 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:33.735800 (+ 370us) client_negotiation.cc:769] Sending connection context
0808 05:57:33.736069 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 05:57:33.736525 (+ 456us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"thread_start_us":141,"threads_started":1}
I20260808 05:57:33.738719 18616 raft_consensus.cc:348] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:33.739274 18616 raft_consensus.cc:729] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d924f4d80f924cdba4b5d368296f8bae, State: Initialized, Role: FOLLOWER
I20260808 05:57:33.739777 18616 consensus_queue.cc:260] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:33.740506 18731 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44283
I20260808 05:57:33.740792 18731 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:33.740862 18616 ts_tablet_manager.cc:1428] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Time spent starting tablet: real 0.005s user 0.007s sys 0.001s
I20260808 05:57:33.741317 18731 heartbeater.cc:511] Master 127.2.191.126:44283 requested a full tablet report, sending...
I20260808 05:57:33.743884 18530 ts_manager.cc:194] Registered new tserver with Master: d924f4d80f924cdba4b5d368296f8bae (127.2.191.65:38691)
I20260808 05:57:33.747982 18530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:55659
I20260808 05:57:33.750932 18731 heartbeater.cc:503] Master 127.2.191.126:44283 was elected leader, sending a full tablet report...
Aug 08 05:57:33 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168653, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:57:33.759639 18739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.747263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45290 (local address 127.2.191.65:38691)
0808 05:57:33.747687 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:33.747698 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:33.748226 (+ 528us) server_negotiation.cc:407] Connection header received
0808 05:57:33.748539 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:33.748547 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:33.748821 (+ 274us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:33.749005 (+ 184us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:33.749852 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.751176 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.752285 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.752661 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.752858 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.755720 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:33.755730 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:33.755740 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:33.755764 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:33.757509 (+ 1745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:33.758135 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:33.758140 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:33.758141 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:33.758229 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:33.758573 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:33.758576 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:33.758578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:33.758823 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:33.758930 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:33.759357 (+ 427us) server_negotiation.cc:299] Negotiation successful
0808 05:57:33.759512 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":109,"threads_started":1}
I20260808 05:57:33.759791 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.747144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:38691 (local address 127.0.0.1:45290)
0808 05:57:33.748072 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:33.748127 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:33.748344 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:33.749029 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:33.749036 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:33.749532 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:33.749688 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.749698 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.751322 (+ 1624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.751326 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.752148 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.752158 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.752991 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.752995 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.753122 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.753751 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:33.753770 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:33.755567 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:33.757630 (+ 2063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:33.757641 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:33.757647 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:33.757976 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:33.758343 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:33.758347 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:33.758349 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:33.758458 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:33.758955 (+ 497us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:33.758961 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:33.759107 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 05:57:33.759268 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 05:57:33.759483 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"thread_start_us":114,"threads_started":1}
I20260808 05:57:33.760924 18660 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b7a50c71a244bbca0a72739202ed95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:33 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:45290
I20260808 05:57:33.761771 18740 tablet_replica.cc:330] stopping tablet replica
I20260808 05:57:33.762079 18740 raft_consensus.cc:2229] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:57:33.762324 18740 raft_consensus.cc:2258] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:33.763283 18740 ts_tablet_manager.cc:1905] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:33.766871 18740 ts_tablet_manager.cc:1918] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:33.766968 18740 log.cc:1196] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/9b7a50c71a244bbca0a72739202ed95b
I20260808 05:57:33.767277 18740 ts_tablet_manager.cc:1939] T 9b7a50c71a244bbca0a72739202ed95b P d924f4d80f924cdba4b5d368296f8bae: Deleting consensus metadata
I20260808 05:57:33.769126 18516 catalog_manager.cc:4841] TS d924f4d80f924cdba4b5d368296f8bae (127.2.191.65:38691): tablet 9b7a50c71a244bbca0a72739202ed95b (table test-table [id=1c24c5673c7140c3955896f09c9208c3]) successfully deleted
W20260808 05:57:33.862633 18736 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:33.862957 18736 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:33.863041 18736 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:33.867619 18736 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:33.867727 18736 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:33.867827 18736 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:57:33.873476 18736 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:34581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=38415
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18736
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:33.874923 18736 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:33.876030 18736 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:33.886425 18746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:33.886480 18745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:33.886466 18748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:33.886905 18736 server_base.cc:1034] running on GCE node
I20260808 05:57:33.887471 18736 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:33.888247 18736 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:33.889470 18736 hybrid_clock.cc:648] HybridClock initialized: now 1786168653889442 us; error 39 us; skew 500 ppm
Aug 08 05:57:33 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168653, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:33.892503 18736 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:57:33.893594 18736 webserver.cc:460] Webserver started at http://127.2.191.66:38415/ using document root <none> and password file <none>
I20260808 05:57:33.894255 18736 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:33.894372 18736 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:33.898752 18736 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.002s
I20260808 05:57:33.901130 18755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:33.902424 18736 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:57:33.902581 18736 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "5689ee6bf4c446d4991c1f6e39c53b38"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "53aaed4904b148aa03fd48c6c352e4cb"
server_key_iv: "3cfb5a0f3f5858550ce247d10bbc874f"
server_key_version: "encryptionkey@0"
I20260808 05:57:33.903136 18736 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:33.932328 18736 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:33.935773 18736 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:33.936005 18736 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:33.936673 18736 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:33.937855 18762 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:57:33.942081 18736 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:57:33.942173 18736 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260808 05:57:33.942260 18736 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:57:33.943970 18736 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:57:33.944039 18736 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 05:57:33.944339 18762 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Bootstrap starting.
I20260808 05:57:33.950762 18762 log.cc:824] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:33.954221 18736 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:34581
I20260808 05:57:33.954291 18877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:34581 every 8 connection(s)
I20260808 05:57:33.955108 18736 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:57:33.959141 18762 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:57:33.959568 18762 tablet_bootstrap.cc:492] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Bootstrap complete.
I20260808 05:57:33.959914 18762 ts_tablet_manager.cc:1397] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20260808 05:57:33.962682 18762 raft_consensus.cc:348] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:33.963138 18762 raft_consensus.cc:729] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5689ee6bf4c446d4991c1f6e39c53b38, State: Initialized, Role: FOLLOWER
I20260808 05:57:33.963478 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 18736
I20260808 05:57:33.963737 18762 consensus_queue.cc:260] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } } peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } }
I20260808 05:57:33.963964 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:41953
--local_ip_for_outbound_sockets=127.2.191.67
--tserver_master_addrs=127.2.191.126:44283
--webserver_port=40203
--webserver_interface=127.2.191.67
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:33.964854 18762 ts_tablet_manager.cc:1428] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
Aug 08 05:57:33 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168653, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:33.970192 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.957039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:50777 (local address 127.2.191.126:44283)
0808 05:57:33.957206 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:33.957211 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:33.957844 (+ 633us) server_negotiation.cc:407] Connection header received
0808 05:57:33.958822 (+ 978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:33.958825 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:33.958885 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:33.958993 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:33.960248 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.961043 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.962173 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.962505 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.962626 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.966087 (+ 3461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:33.966091 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:33.966095 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:33.966131 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:33.967765 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:33.968400 (+ 635us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:33.968406 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:33.968408 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:33.968508 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:33.968961 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:33.968965 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:33.968967 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:33.969181 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:33.969299 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:33.969828 (+ 529us) server_negotiation.cc:299] Negotiation successful
0808 05:57:33.969993 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 05:57:33.971012 18880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.957193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:50777)
0808 05:57:33.957671 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:33.957725 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:33.958605 (+ 880us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:33.959112 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:33.959118 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:33.959535 (+ 417us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:33.960093 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.960109 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.961202 (+ 1093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.961205 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.962043 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.962054 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.962653 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.962657 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.962828 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.963994 (+ 1166us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:33.964020 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:33.965898 (+ 1878us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:33.967901 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:33.967908 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:33.967923 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:33.968281 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:33.968616 (+ 335us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:33.968620 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:33.968622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:33.968835 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:33.969297 (+ 462us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:33.969304 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:33.969577 (+ 273us) client_negotiation.cc:769] Sending connection context
0808 05:57:33.969782 (+ 205us) client_negotiation.cc:240] Negotiation successful
0808 05:57:33.970130 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":125,"threads_started":1}
I20260808 05:57:33.972415 18878 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44283
I20260808 05:57:33.972779 18878 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:33.973407 18878 heartbeater.cc:511] Master 127.2.191.126:44283 requested a full tablet report, sending...
I20260808 05:57:33.975513 18530 ts_manager.cc:194] Registered new tserver with Master: 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
I20260808 05:57:33.977079 18530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:50777
I20260808 05:57:33.979700 18878 heartbeater.cc:503] Master 127.2.191.126:44283 was elected leader, sending a full tablet report...
Aug 08 05:57:33 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168653, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.66@KRBTEST.COM
I20260808 05:57:33.987887 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.977152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34581 (local address 127.0.0.1:45302)
0808 05:57:33.977421 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:33.977441 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:33.977569 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:33.978294 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:33.978298 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:33.978516 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:33.978618 (+ 102us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.978647 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.979773 (+ 1126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.979778 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.980631 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:33.980643 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.981913 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.981916 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:33.982001 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.982562 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:33.982576 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:33.984023 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:33.986148 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:33.986153 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:33.986155 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:33.986420 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:33.986749 (+ 329us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:33.986753 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:33.986757 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:33.986860 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:33.987303 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:33.987307 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:33.987414 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 05:57:33.987526 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 05:57:33.987698 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169}
I20260808 05:57:33.987902 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:33.977260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45302 (local address 127.2.191.66:34581)
0808 05:57:33.977762 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:33.977776 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:33.977806 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:57:33.977868 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:33.977873 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:33.978146 (+ 273us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:33.978312 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:33.978814 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.979644 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.980942 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:33.981789 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:33.981906 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:33.984184 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:33.984193 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:33.984206 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:33.984229 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:33.986034 (+ 1805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:33.986563 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:33.986568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:33.986569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:33.986654 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:33.986948 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:33.986952 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:33.986953 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:33.987199 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:33.987308 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:33.987623 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 05:57:33.987766 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":390,"spinlock_wait_cycles":3840,"thread_start_us":132,"threads_started":1}
I20260808 05:57:33.989215 18807 tablet_service.cc:1514] Processing DeleteTablet for tablet 9b7a50c71a244bbca0a72739202ed95b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:33 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:45302
I20260808 05:57:33.990269 18884 tablet_replica.cc:330] stopping tablet replica
I20260808 05:57:33.990590 18884 raft_consensus.cc:2229] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:57:33.990850 18884 raft_consensus.cc:2258] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:33.991892 18884 ts_tablet_manager.cc:1905] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:33.995858 18884 ts_tablet_manager.cc:1918] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:33.995967 18884 log.cc:1196] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/9b7a50c71a244bbca0a72739202ed95b
I20260808 05:57:33.996291 18884 ts_tablet_manager.cc:1939] T 9b7a50c71a244bbca0a72739202ed95b P 5689ee6bf4c446d4991c1f6e39c53b38: Deleting consensus metadata
I20260808 05:57:33.998071 18516 catalog_manager.cc:4841] TS 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581): tablet 9b7a50c71a244bbca0a72739202ed95b (table test-table [id=1c24c5673c7140c3955896f09c9208c3]) successfully deleted
W20260808 05:57:34.088442 18882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:34.088770 18882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:34.088851 18882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:34.092975 18882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:34.093048 18882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:34.093142 18882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:57:34.098454 18882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:41953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=40203
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:34.099609 18882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:34.100649 18882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:34.110735 18894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:34.110715 18892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:34.110915 18882 server_base.cc:1034] running on GCE node
W20260808 05:57:34.110715 18891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:34.111518 18882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:34.112180 18882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:34.113390 18882 hybrid_clock.cc:648] HybridClock initialized: now 1786168654113363 us; error 43 us; skew 500 ppm
Aug 08 05:57:34 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168654, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:34.116255 18882 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:57:34.117221 18882 webserver.cc:460] Webserver started at http://127.2.191.67:40203/ using document root <none> and password file <none>
I20260808 05:57:34.117794 18882 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:34.117906 18882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:34.121815 18882 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:57:34.123874 18901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:34.125204 18882 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:57:34.125335 18882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "eb8359ef71f540cdaefd35b733eb3220"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5b5daefaa1a2ec313d7ae137f0b3b8c9"
server_key_iv: "6363fb51fd826fa4b48ec26653942be7"
server_key_version: "encryptionkey@0"
I20260808 05:57:34.125897 18882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:34.140846 18882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:34.144423 18882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:34.144649 18882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:34.145334 18882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:34.146204 18882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:34.146274 18882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:34.146348 18882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:34.146395 18882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:34.156038 18882 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:41953
I20260808 05:57:34.156061 19021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:41953 every 8 connection(s)
I20260808 05:57:34.157151 18882 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:57:34.163584 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 18882
Aug 08 05:57:34 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168654, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:34.172541 18733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.159156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:35689 (local address 127.2.191.126:44283)
0808 05:57:34.159313 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:34.159317 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:34.160186 (+ 869us) server_negotiation.cc:407] Connection header received
0808 05:57:34.161485 (+ 1299us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:34.161489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:34.161537 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:34.161619 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:34.162831 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.163672 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.165147 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.165557 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.165706 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.168468 (+ 2762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:34.168473 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:34.168479 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:34.168511 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:34.170234 (+ 1723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:34.170770 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:34.170775 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:34.170777 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:34.170861 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:34.171210 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:34.171213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:34.171215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:34.171404 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:34.171511 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:34.172216 (+ 705us) server_negotiation.cc:299] Negotiation successful
0808 05:57:34.172334 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 05:57:34.173544 19025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.164334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58936 (local address 127.2.191.126:44283)
0808 05:57:34.164594 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:34.164598 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:34.164834 (+ 236us) server_negotiation.cc:407] Connection header received
0808 05:57:34.164956 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:34.164959 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:34.165009 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:34.165122 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:34.166225 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.166960 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.167876 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.168171 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.168283 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.170009 (+ 1726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:34.170012 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:34.170014 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:34.170048 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:34.171537 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:34.171990 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:34.171992 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:34.171994 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:34.172097 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:34.172408 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:34.172412 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:34.172413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:34.172619 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:34.172846 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:34.173265 (+ 419us) server_negotiation.cc:299] Negotiation successful
0808 05:57:34.173392 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":109,"threads_started":1}
I20260808 05:57:34.173849 19024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.159560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:35689)
0808 05:57:34.160020 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.160065 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:34.161283 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:34.161782 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:34.161788 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:34.162154 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:34.162643 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:34.162656 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.163830 (+ 1174us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.163833 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:34.165006 (+ 1173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:34.165016 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.165720 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.165723 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:34.165920 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.166718 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:34.166738 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:34.168313 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:34.170355 (+ 2042us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:34.170362 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:34.170378 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:34.170662 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:34.170953 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:34.170957 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:34.170960 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:34.171110 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:34.171510 (+ 400us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:34.171518 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:34.171884 (+ 366us) client_negotiation.cc:769] Sending connection context
0808 05:57:34.172153 (+ 269us) client_negotiation.cc:240] Negotiation successful
0808 05:57:34.172539 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":125,"threads_started":1}
I20260808 05:57:34.175379 19022 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44283
I20260808 05:57:34.175676 19022 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:34.176265 19022 heartbeater.cc:511] Master 127.2.191.126:44283 requested a full tablet report, sending...
I20260808 05:57:34.177269 18530 ts_manager.cc:194] Registered new tserver with Master: eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953)
I20260808 05:57:34.177820 18530 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:35689
I20260808 05:57:34.187736 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:57:34.191939 19025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.188361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58950 (local address 127.2.191.126:44283)
0808 05:57:34.188495 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:34.188499 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:34.188681 (+ 182us) server_negotiation.cc:407] Connection header received
0808 05:57:34.188872 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:34.188874 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:34.188989 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:34.189120 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:57:34.189339 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.189853 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.190643 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.190862 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.190940 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.191222 (+ 282us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:57:34.191619 (+ 397us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:57:34.191711 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:34.191778 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 05:57:34.191831 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:57:34.192560 18530 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:58950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:57:34.195879 18530 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:57:34.203377 18660 tablet_service.cc:1467] Processing CreateTablet for tablet d8815ccc35b048738375c78265c57af2 (DEFAULT_TABLE table=test-table [id=cbbf7c9cbf90439da81c02ce45b29081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:34.203459 18807 tablet_service.cc:1467] Processing CreateTablet for tablet d8815ccc35b048738375c78265c57af2 (DEFAULT_TABLE table=test-table [id=cbbf7c9cbf90439da81c02ce45b29081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:34.204071 18660 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8815ccc35b048738375c78265c57af2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:34.204121 18807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8815ccc35b048738375c78265c57af2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:34.207142 18762 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: Bootstrap starting.
I20260808 05:57:34.207221 18616 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Bootstrap starting.
I20260808 05:57:34.208173 18762 tablet_bootstrap.cc:654] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:34.208173 18616 tablet_bootstrap.cc:654] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:34.208801 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.202616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41953 (local address 127.0.0.1:49662)
0808 05:57:34.202831 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.202848 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:34.202932 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:34.203953 (+ 1021us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:34.203957 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:34.203981 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:34.204089 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:34.204097 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.205557 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.205561 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:34.206818 (+ 1257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:34.206833 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.208306 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.208309 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:34.208408 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.208461 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 05:57:34.208519 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:57:34.208627 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260808 05:57:34.209383 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.202946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49662 (local address 127.2.191.67:41953)
0808 05:57:34.203340 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:34.203353 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:34.203379 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:57:34.203541 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:34.203548 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:34.203779 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:34.204037 (+ 258us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:34.204215 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.205387 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.206996 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.208163 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.208909 (+ 746us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.209079 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:34.209128 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 05:57:34.209235 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":172,"threads_started":1}
I20260808 05:57:34.210224 18616 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: No bootstrap required, opened a new log
I20260808 05:57:34.210325 18762 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: No bootstrap required, opened a new log
I20260808 05:57:34.210333 18616 ts_tablet_manager.cc:1397] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260808 05:57:34.210427 18762 ts_tablet_manager.cc:1397] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:57:34.210798 18616 raft_consensus.cc:348] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.210924 18616 raft_consensus.cc:374] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:34.210968 18616 raft_consensus.cc:729] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d924f4d80f924cdba4b5d368296f8bae, State: Initialized, Role: FOLLOWER
I20260808 05:57:34.210901 18762 raft_consensus.cc:348] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.211025 18762 raft_consensus.cc:374] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:34.211074 18762 raft_consensus.cc:729] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5689ee6bf4c446d4991c1f6e39c53b38, State: Initialized, Role: FOLLOWER
I20260808 05:57:34.211103 18616 consensus_queue.cc:260] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.211228 18762 consensus_queue.cc:260] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.211360 18616 ts_tablet_manager.cc:1428] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 05:57:34.211526 18762 ts_tablet_manager.cc:1428] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:57:34.212916 18952 tablet_service.cc:1467] Processing CreateTablet for tablet d8815ccc35b048738375c78265c57af2 (DEFAULT_TABLE table=test-table [id=cbbf7c9cbf90439da81c02ce45b29081]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:34.214184 18952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8815ccc35b048738375c78265c57af2. 1 dirs total, 0 dirs full, 0 dirs failed
W20260808 05:57:34.217630 18732 tablet.cc:2369] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:57:34.221488 19034 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: Bootstrap starting.
I20260808 05:57:34.223591 19034 tablet_bootstrap.cc:654] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:34.224720 19034 log.cc:824] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:34.226907 19034 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: No bootstrap required, opened a new log
I20260808 05:57:34.227149 19034 ts_tablet_manager.cc:1397] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 05:57:34.230355 19034 raft_consensus.cc:348] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.230618 19034 raft_consensus.cc:374] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:34.230654 19034 raft_consensus.cc:729] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8359ef71f540cdaefd35b733eb3220, State: Initialized, Role: FOLLOWER
I20260808 05:57:34.231146 19034 consensus_queue.cc:260] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.231819 19022 heartbeater.cc:503] Master 127.2.191.126:44283 was elected leader, sending a full tablet report...
I20260808 05:57:34.232172 19034 ts_tablet_manager.cc:1428] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260808 05:57:34.254380 19036 raft_consensus.cc:482] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:34.254603 19036 raft_consensus.cc:504] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.255795 19036 leader_election.cc:288] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d924f4d80f924cdba4b5d368296f8bae (127.2.191.65:38691), 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
I20260808 05:57:34.259393 18739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.256110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:54685 (local address 127.2.191.65:38691)
0808 05:57:34.256251 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:34.256255 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:34.256270 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:57:34.256416 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:34.256422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:34.256496 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:34.256604 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:34.256912 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.257435 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.258445 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.258880 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.259010 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.259188 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:34.259225 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 05:57:34.259290 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:57:34.259393 19024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.255976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:38691 (local address 127.2.191.67:54685)
0808 05:57:34.256163 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.256181 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:34.256279 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:34.256633 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:34.256636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:34.256652 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:34.256804 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:34.256810 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.257550 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.257554 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:34.258323 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:34.258332 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.259002 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.259006 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:34.259105 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.259127 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 05:57:34.259191 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:57:34.259264 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89}
I20260808 05:57:34.259882 19037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.256294 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34581 (local address 127.2.191.67:37721)
0808 05:57:34.256664 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.256675 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:34.256818 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:34.257100 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:34.257103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:34.257118 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:34.257241 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:34.257246 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.257981 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.257984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:34.258756 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:34.258764 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.259466 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.259470 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:34.259572 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.259593 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 05:57:34.259676 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:57:34.259749 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":319,"thread_start_us":137,"threads_started":1}
I20260808 05:57:34.259884 18883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.256412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:37721 (local address 127.2.191.66:34581)
0808 05:57:34.256544 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:34.256550 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:34.256765 (+ 215us) server_negotiation.cc:407] Connection header received
0808 05:57:34.256928 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:34.256932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:34.256995 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:34.257090 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:34.257345 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.257865 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.258877 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.259326 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.259465 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.259593 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:34.259691 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 05:57:34.259779 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:57:34.260041 18681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8815ccc35b048738375c78265c57af2" candidate_uuid: "eb8359ef71f540cdaefd35b733eb3220" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d924f4d80f924cdba4b5d368296f8bae" is_pre_election: true
I20260808 05:57:34.260387 18681 raft_consensus.cc:2454] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb8359ef71f540cdaefd35b733eb3220 in term 0.
I20260808 05:57:34.260664 18829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8815ccc35b048738375c78265c57af2" candidate_uuid: "eb8359ef71f540cdaefd35b733eb3220" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" is_pre_election: true
I20260808 05:57:34.260907 18904 leader_election.cc:302] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d924f4d80f924cdba4b5d368296f8bae, eb8359ef71f540cdaefd35b733eb3220; no voters:
I20260808 05:57:34.260985 18829 raft_consensus.cc:2454] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb8359ef71f540cdaefd35b733eb3220 in term 0.
I20260808 05:57:34.261277 19036 raft_consensus.cc:2781] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:57:34.261381 19036 raft_consensus.cc:482] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:57:34.261445 19036 raft_consensus.cc:3037] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:34.262526 19036 raft_consensus.cc:504] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.262853 19036 leader_election.cc:288] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [CANDIDATE]: Term 1 election: Requested vote from peers d924f4d80f924cdba4b5d368296f8bae (127.2.191.65:38691), 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
I20260808 05:57:34.263207 18681 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8815ccc35b048738375c78265c57af2" candidate_uuid: "eb8359ef71f540cdaefd35b733eb3220" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d924f4d80f924cdba4b5d368296f8bae"
I20260808 05:57:34.263286 18829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8815ccc35b048738375c78265c57af2" candidate_uuid: "eb8359ef71f540cdaefd35b733eb3220" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5689ee6bf4c446d4991c1f6e39c53b38"
I20260808 05:57:34.263353 18681 raft_consensus.cc:3037] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:34.263427 18829 raft_consensus.cc:3037] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:34.264423 18681 raft_consensus.cc:2454] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb8359ef71f540cdaefd35b733eb3220 in term 1.
I20260808 05:57:34.264645 18829 raft_consensus.cc:2454] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb8359ef71f540cdaefd35b733eb3220 in term 1.
I20260808 05:57:34.264721 18904 leader_election.cc:302] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d924f4d80f924cdba4b5d368296f8bae, eb8359ef71f540cdaefd35b733eb3220; no voters:
I20260808 05:57:34.264920 19036 raft_consensus.cc:2781] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:34.265199 19036 raft_consensus.cc:686] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 1 LEADER]: Becoming Leader. State: Replica: eb8359ef71f540cdaefd35b733eb3220, State: Running, Role: LEADER
I20260808 05:57:34.265583 19036 consensus_queue.cc:237] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.268793 18530 catalog_manager.cc:5495] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67). New cstate: current_term: 1 leader_uuid: "eb8359ef71f540cdaefd35b733eb3220" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } health_report { overall_health: UNKNOWN } } }
I20260808 05:57:34.290410 19031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.286660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49676 (local address 127.2.191.67:41953)
0808 05:57:34.286802 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:34.286805 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:34.286818 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:57:34.286889 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:34.286891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:34.286941 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:34.287027 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:57:34.287233 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.287726 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.288764 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:34.289164 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:34.289272 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:34.289594 (+ 322us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:57:34.290000 (+ 406us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:57:34.290143 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:34.290205 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 05:57:34.290264 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:57:34.296213 18829 raft_consensus.cc:1261] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Refusing update from remote peer eb8359ef71f540cdaefd35b733eb3220: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:34.296212 18681 raft_consensus.cc:1261] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Refusing update from remote peer eb8359ef71f540cdaefd35b733eb3220: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:34.296943 19038 consensus_queue.cc:1035] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:34.297127 19036 consensus_queue.cc:1035] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:34.302469 19041 mvcc.cc:205] Tried to move back new op lower bound from 7316146807990251520 to 7316146807874842624. Current Snapshot: MvccSnapshot[applied={T|T < 7316146807990251520}]
I20260808 05:57:34.305995 19042 mvcc.cc:205] Tried to move back new op lower bound from 7316146807990251520 to 7316146807874842624. Current Snapshot: MvccSnapshot[applied={T|T < 7316146807990251520}]
I20260808 05:57:34.311188 18529 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:58950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:57:34.311381 18529 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:58950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:57:34.313676 18529 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Sending DeleteTablet for 3 replicas of tablet d8815ccc35b048738375c78265c57af2
I20260808 05:57:34.314359 18952 tablet_service.cc:1514] Processing DeleteTablet for tablet d8815ccc35b048738375c78265c57af2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:34 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:49662
I20260808 05:57:34.314429 18660 tablet_service.cc:1514] Processing DeleteTablet for tablet d8815ccc35b048738375c78265c57af2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:34 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:45290
I20260808 05:57:34.314491 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 18570
I20260808 05:57:34.315809 18807 tablet_service.cc:1514] Processing DeleteTablet for tablet d8815ccc35b048738375c78265c57af2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:34 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:45302
I20260808 05:57:34.315992 18884 tablet_replica.cc:330] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: stopping tablet replica
I20260808 05:57:34.316136 18884 raft_consensus.cc:2229] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:57:34.316265 18884 raft_consensus.cc:2258] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:34.317230 19052 tablet_replica.cc:330] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: stopping tablet replica
I20260808 05:57:34.317312 18884 ts_tablet_manager.cc:1905] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:34.317706 19052 raft_consensus.cc:2229] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:57:34.318233 19052 raft_consensus.cc:2258] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:34.320008 18884 ts_tablet_manager.cc:1918] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:34.320113 18884 log.cc:1196] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/d8815ccc35b048738375c78265c57af2
I20260808 05:57:34.320005 19052 ts_tablet_manager.cc:1905] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:34.320389 18884 ts_tablet_manager.cc:1939] T d8815ccc35b048738375c78265c57af2 P 5689ee6bf4c446d4991c1f6e39c53b38: Deleting consensus metadata
I20260808 05:57:34.321269 18516 catalog_manager.cc:4841] TS 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581): tablet d8815ccc35b048738375c78265c57af2 (table test-table [id=cbbf7c9cbf90439da81c02ce45b29081]) successfully deleted
I20260808 05:57:34.324025 19052 ts_tablet_manager.cc:1918] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:34.324159 19052 log.cc:1196] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/d8815ccc35b048738375c78265c57af2
I20260808 05:57:34.324529 19052 ts_tablet_manager.cc:1939] T d8815ccc35b048738375c78265c57af2 P eb8359ef71f540cdaefd35b733eb3220: Deleting consensus metadata
I20260808 05:57:34.325984 18515 catalog_manager.cc:4841] TS eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953): tablet d8815ccc35b048738375c78265c57af2 (table test-table [id=cbbf7c9cbf90439da81c02ce45b29081]) successfully deleted
W20260808 05:57:34.327131 18516 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:38691 (error 108)
I20260808 05:57:34.327716 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 18736
I20260808 05:57:34.329514 18738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.327989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:38691 (local address 127.0.0.1:45304)
0808 05:57:34.329307 (+ 1318us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.329415 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:38691: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1219}
W20260808 05:57:34.331167 18516 catalog_manager.cc:4584] TS d924f4d80f924cdba4b5d368296f8bae (127.2.191.65:38691): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d8815ccc35b048738375c78265c57af2: Network error: Client connection negotiation failed: client connection to 127.2.191.65:38691: connect: Connection refused (error 111)
I20260808 05:57:34.337069 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 18882
I20260808 05:57:34.344201 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 18497
I20260808 05:57:34.353149 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44283
--webserver_interface=127.2.191.126
--webserver_port=45337
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:44283
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:34.468467 19054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:34.468786 19054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:34.468868 19054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:34.472944 19054 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:34.473011 19054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:34.473030 19054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:34.473047 19054 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:34.473107 19054 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:34.478539 19054 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:44283
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44283
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=45337
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:34.479692 19054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:34.480767 19054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:34.489535 19060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:34.489552 19063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:34.489540 19059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:34.489830 19054 server_base.cc:1034] running on GCE node
I20260808 05:57:34.490437 19054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:34.491637 19054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:34.492817 19054 hybrid_clock.cc:648] HybridClock initialized: now 1786168654492797 us; error 29 us; skew 500 ppm
Aug 08 05:57:34 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168654, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:34.495630 19054 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:57:34.496578 19054 webserver.cc:460] Webserver started at http://127.2.191.126:45337/ using document root <none> and password file <none>
I20260808 05:57:34.497177 19054 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:34.497241 19054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:34.501205 19054 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:57:34.503328 19070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:34.504539 19054 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:57:34.504669 19054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "10a60cf80b6b476b96bd46b4c97b7ac1"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "65eecfc0d383de312a9b2331064886a5"
server_key_iv: "10bd8ef68698b902f791ce62bd3b9afa"
server_key_version: "encryptionkey@0"
I20260808 05:57:34.505254 19054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:34.523778 19054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:34.526894 19054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:34.527113 19054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:34.534708 19054 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:44283
I20260808 05:57:34.535073 19125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:44283 every 8 connection(s)
I20260808 05:57:34.535907 19054 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:57:34.540277 19126 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:57:34.540539 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 19054
I20260808 05:57:34.541018 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:38691
--local_ip_for_outbound_sockets=127.2.191.65
--tserver_master_addrs=127.2.191.126:44283
--webserver_port=44463
--webserver_interface=127.2.191.65
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:34.542219 19126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Bootstrap starting.
I20260808 05:57:34.560197 19126 log.cc:824] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:34.571535 19126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:57:34.571954 19126 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1: Bootstrap complete.
I20260808 05:57:34.576076 19126 raft_consensus.cc:348] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:34.576486 19126 raft_consensus.cc:729] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10a60cf80b6b476b96bd46b4c97b7ac1, State: Initialized, Role: FOLLOWER
I20260808 05:57:34.577013 19126 consensus_queue.cc:260] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:34.577159 19126 raft_consensus.cc:388] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:57:34.577243 19126 raft_consensus.cc:482] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:57:34.577356 19126 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 2 FOLLOWER]: Advancing to term 3
I20260808 05:57:34.579257 19126 raft_consensus.cc:504] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:34.579604 19126 leader_election.cc:302] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10a60cf80b6b476b96bd46b4c97b7ac1; no voters:
I20260808 05:57:34.579945 19126 leader_election.cc:288] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 05:57:34.580037 19130 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 05:57:34.580283 19130 raft_consensus.cc:686] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [term 3 LEADER]: Becoming Leader. State: Replica: 10a60cf80b6b476b96bd46b4c97b7ac1, State: Running, Role: LEADER
I20260808 05:57:34.580593 19130 consensus_queue.cc:237] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } }
I20260808 05:57:34.581313 19126 sys_catalog.cc:564] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:34.581599 19130 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10a60cf80b6b476b96bd46b4c97b7ac1. Latest consensus state: current_term: 3 leader_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } } }
I20260808 05:57:34.581722 19130 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:34.582098 19134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:57:34.582139 19131 sys_catalog.cc:455] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10a60cf80b6b476b96bd46b4c97b7ac1" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44283 } } }
I20260808 05:57:34.582365 19131 sys_catalog.cc:458] T 00000000000000000000000000000000 P 10a60cf80b6b476b96bd46b4c97b7ac1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:34.587788 19134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:57:34.588505 19134 catalog_manager.cc:1259] Loaded cluster ID: abaa5c619aca4439b5df2ae71e7accc7
I20260808 05:57:34.588572 19134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 05:57:34.590975 19134 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fb3376e49ad google::LogMessage::Fail() at ??:0
@ 0x7fb3376e788a google::LogMessage::SendToLog() at ??:0
@ 0x7fb3376e44de google::LogMessage::Flush() at ??:0
@ 0x7fb3376e5a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fb342023fdd _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fb342024d2f kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fb342021579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fb342065640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fb3399363d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fb339936c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fb3399383f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fb339927512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fb33af6b6db start_thread at ??:0
@ 0x7fb3361e261f clone at ??:0
W20260808 05:57:34.673570 19128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:34.673894 19128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:34.673986 19128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:34.678274 19128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:34.678356 19128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:34.678457 19128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:57:34.683969 19128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:38691
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=44463
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:34.685189 19128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:34.686246 19128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:34.696197 19169 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:34.696206 19174 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:34.696388 19128 server_base.cc:1034] running on GCE node
W20260808 05:57:34.696213 19170 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:34.697036 19128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:34.697750 19128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:34.698931 19128 hybrid_clock.cc:648] HybridClock initialized: now 1786168654698916 us; error 39 us; skew 500 ppm
Aug 08 05:57:34 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168654, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:34.701938 19128 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:57:34.702822 19128 webserver.cc:460] Webserver started at http://127.2.191.65:44463/ using document root <none> and password file <none>
I20260808 05:57:34.703395 19128 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:34.703490 19128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:34.707566 19128 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:57:34.710031 19181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:34.711581 19128 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:57:34.711727 19128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "d924f4d80f924cdba4b5d368296f8bae"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5bf5282ef1d90705e2e1d0a445cd22df"
server_key_iv: "7cf2b2b6eb1563ef1f6242e1e954ddae"
server_key_version: "encryptionkey@0"
I20260808 05:57:34.712335 19128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:34.730691 19128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:34.734467 19128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:34.734699 19128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:34.735335 19128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:34.736569 19189 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:57:34.742420 19128 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:57:34.742538 19128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260808 05:57:34.742633 19128 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:57:34.745618 19128 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:57:34.745697 19128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260808 05:57:34.746341 19189 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Bootstrap starting.
I20260808 05:57:34.759352 19128 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:38691
I20260808 05:57:34.760663 19128 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:57:34.761736 19302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:38691 every 8 connection(s)
I20260808 05:57:34.769186 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 19128
I20260808 05:57:34.769711 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:34581
--local_ip_for_outbound_sockets=127.2.191.66
--tserver_master_addrs=127.2.191.126:44283
--webserver_port=38415
--webserver_interface=127.2.191.66
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:34.771361 19189 log.cc:824] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:34.779990 19189 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:57:34.780473 19189 tablet_bootstrap.cc:492] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Bootstrap complete.
I20260808 05:57:34.782282 19189 ts_tablet_manager.cc:1397] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Time spent bootstrapping tablet: real 0.036s user 0.023s sys 0.008s
I20260808 05:57:34.786587 19189 raft_consensus.cc:348] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.787289 19189 raft_consensus.cc:729] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d924f4d80f924cdba4b5d368296f8bae, State: Initialized, Role: FOLLOWER
I20260808 05:57:34.787844 19189 consensus_queue.cc:260] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:34.788978 19189 ts_tablet_manager.cc:1428] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
W20260808 05:57:34.824529 19305 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:57:34.763241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:48365)
0808 05:57:34.763841 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.763902 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:34.764980 (+ 1078us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:34.823633 (+ 58653us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":155,"threads_started":1}
W20260808 05:57:34.825217 19303 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:44283 (0 consecutive failures): Network error: Failed to ping master at 127.2.191.126:44283: Client connection negotiation failed: client connection to 127.2.191.126:44283: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:57:34.826062 19305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.825748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:38121)
0808 05:57:34.825889 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.825974 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 05:57:34.826843 19305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.826618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:43075)
0808 05:57:34.826730 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.826782 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260808 05:57:34.827062 19303 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:57:34.910349 19306 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:34.910658 19306 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:34.910733 19306 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:34.914847 19306 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:34.914908 19306 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:34.915007 19306 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:57:34.920486 19306 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:34581
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=38415
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19306
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:34.921595 19306 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:34.922652 19306 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:34.932749 19313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:34.932896 19316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:34.932816 19306 server_base.cc:1034] running on GCE node
W20260808 05:57:34.932809 19314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:34.933434 19306 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:34.934132 19306 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:34.935295 19306 hybrid_clock.cc:648] HybridClock initialized: now 1786168654935270 us; error 36 us; skew 500 ppm
Aug 08 05:57:34 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168654, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:34.938148 19306 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:57:34.938963 19306 webserver.cc:460] Webserver started at http://127.2.191.66:38415/ using document root <none> and password file <none>
I20260808 05:57:34.939477 19306 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:34.939535 19306 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:34.943478 19306 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:57:34.945662 19323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:34.946942 19306 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:57:34.947079 19306 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "5689ee6bf4c446d4991c1f6e39c53b38"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "53aaed4904b148aa03fd48c6c352e4cb"
server_key_iv: "3cfb5a0f3f5858550ce247d10bbc874f"
server_key_version: "encryptionkey@0"
I20260808 05:57:34.947654 19306 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:34.964126 19306 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:34.967463 19306 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:34.967679 19306 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:34.968292 19306 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:34.969201 19306 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:34.969271 19306 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:34.969341 19306 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:34.969386 19306 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:34.978900 19306 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:34581
I20260808 05:57:34.978987 19446 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:34581 every 8 connection(s)
I20260808 05:57:34.980000 19306 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:57:34.983207 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 19306
I20260808 05:57:34.983685 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:41953
--local_ip_for_outbound_sockets=127.2.191.67
--tserver_master_addrs=127.2.191.126:44283
--webserver_port=40203
--webserver_interface=127.2.191.67
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:57:34.984367 19449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.982629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:56551)
0808 05:57:34.983376 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.983521 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":114,"threads_started":1}
W20260808 05:57:34.985004 19447 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:44283 (0 consecutive failures): Network error: Failed to ping master at 127.2.191.126:44283: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
I20260808 05:57:34.985713 19449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.985471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:57937)
0808 05:57:34.985593 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.985656 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 05:57:34.986581 19449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:34.986325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:41651)
0808 05:57:34.986474 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:34.986526 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260808 05:57:34.986860 19447 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:57:35.100483 19451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:35.100883 19451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:35.100986 19451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:35.105100 19451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:35.105165 19451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:35.105261 19451 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:57:35.110967 19451 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:41953
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=40203
--tserver_master_addrs=127.2.191.126:44283
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:35.112102 19451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:35.113178 19451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:35.123638 19456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:35.123661 19457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:35.123597 19459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:35.123983 19451 server_base.cc:1034] running on GCE node
I20260808 05:57:35.124467 19451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:35.125265 19451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:35.126475 19451 hybrid_clock.cc:648] HybridClock initialized: now 1786168655126457 us; error 32 us; skew 500 ppm
Aug 08 05:57:35 dist-test-slave-qg60 krb5kdc[17911](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168655, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:35.129622 19451 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:57:35.130577 19451 webserver.cc:460] Webserver started at http://127.2.191.67:40203/ using document root <none> and password file <none>
I20260808 05:57:35.131187 19451 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:35.131253 19451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:35.135249 19451 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:57:35.137406 19466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:35.138731 19451 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:57:35.138859 19451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "eb8359ef71f540cdaefd35b733eb3220"
format_stamp: "Formatted at 2026-08-08 05:57:32 on dist-test-slave-qg60"
server_key: "5b5daefaa1a2ec313d7ae137f0b3b8c9"
server_key_iv: "6363fb51fd826fa4b48ec26653942be7"
server_key_version: "encryptionkey@0"
I20260808 05:57:35.139436 19451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:35.170675 19451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:35.174218 19451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:35.174453 19451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:35.175117 19451 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:35.176002 19451 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:35.176074 19451 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:35.176149 19451 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:35.176188 19451 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:35.185338 19451 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:41953
I20260808 05:57:35.185389 19591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:41953 every 8 connection(s)
I20260808 05:57:35.186393 19451 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:57:35.190397 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:35.188663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:40437)
0808 05:57:35.189227 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:35.189668 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":135,"threads_started":1}
W20260808 05:57:35.190835 19592 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:44283 (0 consecutive failures): Network error: Failed to ping master at 127.2.191.126:44283: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
I20260808 05:57:35.191478 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:35.191256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:59821)
0808 05:57:35.191368 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:35.191425 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 05:57:35.192171 19595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:35.191945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:57807)
0808 05:57:35.192061 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:35.192108 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 05:57:35.192181 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 19451
W20260808 05:57:35.192404 19592 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:57:35.828286 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:35.827756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:40535)
0808 05:57:35.828100 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:35.828166 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":106,"threads_started":1}
I20260808 05:57:35.987927 19598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:35.987501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:48747)
0808 05:57:35.987765 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:35.987821 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":94,"threads_started":1}
I20260808 05:57:36.193627 19599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:36.193089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:49305)
0808 05:57:36.193391 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:36.193455 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":94,"threads_started":1}
I20260808 05:57:36.316779 19600 raft_consensus.cc:482] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:36.317046 19600 raft_consensus.cc:504] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:36.318212 19600 leader_election.cc:288] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953), 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
Aug 08 05:57:36 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168654, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.67@KRBTEST.COM
Aug 08 05:57:36 dist-test-slave-qg60 krb5kdc[17911](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168654, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.66@KRBTEST.COM
I20260808 05:57:36.332660 19602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:36.318565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:41255 (local address 127.2.191.67:41953)
0808 05:57:36.318924 (+ 359us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:36.318949 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:36.318996 (+ 47us) server_negotiation.cc:407] Connection header received
0808 05:57:36.319686 (+ 690us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:36.319691 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:36.320021 (+ 330us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:36.320322 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:36.321597 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:36.322571 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:36.323896 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:36.324364 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:36.324539 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:36.327892 (+ 3353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:36.327897 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:36.327911 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:36.327938 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:36.329930 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:36.330470 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:36.330476 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:36.330482 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:36.330702 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:36.331041 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:36.331045 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:36.331046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:36.331460 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:36.331625 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:36.332149 (+ 524us) server_negotiation.cc:299] Negotiation successful
0808 05:57:36.332450 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":68,"threads_started":1}
I20260808 05:57:36.332688 19601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:36.318445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:34581 (local address 127.2.191.65:45167)
0808 05:57:36.318783 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:36.318798 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:36.318896 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:36.320373 (+ 1477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:36.320378 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:36.320993 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:36.321427 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:36.321441 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:36.322731 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:36.322734 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:36.323764 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:36.323780 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:36.324498 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:36.324501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:36.324783 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:36.325552 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:36.325568 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:36.327735 (+ 2167us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:36.330523 (+ 2788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:36.330527 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:36.330529 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:36.330759 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:36.331149 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:36.331154 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:36.331156 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:36.331250 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:36.331877 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:36.331881 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:36.331987 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 05:57:36.332121 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 05:57:36.332450 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":268,"spinlock_wait_cycles":3456,"thread_start_us":84,"threads_started":1}
I20260808 05:57:36.332693 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:36.318383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41953 (local address 127.2.191.65:41255)
0808 05:57:36.318507 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:36.318525 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:36.318649 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:36.320371 (+ 1722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:36.320377 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:36.320981 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:36.321432 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:36.321441 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:36.322736 (+ 1295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:36.322739 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:36.323766 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:36.323778 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:36.324498 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:36.324501 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:36.324786 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:36.325504 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:36.325528 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:36.327367 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:36.330070 (+ 2703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:36.330076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:36.330091 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:36.330351 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:36.330795 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:36.330799 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:36.330801 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:36.330944 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:36.331600 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:36.331607 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:36.331838 (+ 231us) client_negotiation.cc:769] Sending connection context
0808 05:57:36.332052 (+ 214us) client_negotiation.cc:240] Negotiation successful
0808 05:57:36.332528 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":275,"spinlock_wait_cycles":23936}
I20260808 05:57:36.332824 19603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:36.318743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:45167 (local address 127.2.191.66:34581)
0808 05:57:36.319120 (+ 377us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:36.319140 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:36.319169 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:57:36.319807 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:36.319812 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:36.320115 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:36.320387 (+ 272us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:36.321616 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:36.322575 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:36.323897 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:36.324364 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:36.324547 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:36.327903 (+ 3356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:36.327909 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:36.327922 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:36.327950 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:36.330375 (+ 2425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:36.330893 (+ 518us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:36.330899 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:36.330905 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:36.331039 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:36.331350 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:36.331355 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:36.331357 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:36.331747 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:36.331895 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:36.332285 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 05:57:36.332601 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":95,"threads_started":1}
W20260808 05:57:36.335404 19185 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
W20260808 05:57:36.335608 19184 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
I20260808 05:57:36.335701 19184 leader_election.cc:302] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d924f4d80f924cdba4b5d368296f8bae; no voters: 5689ee6bf4c446d4991c1f6e39c53b38, eb8359ef71f540cdaefd35b733eb3220
I20260808 05:57:36.336055 19600 raft_consensus.cc:2726] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:57:36.829545 19597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:36.829196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:48725)
0808 05:57:36.829360 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:36.829427 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 05:57:36.989252 19604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:36.988793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:38565)
0808 05:57:36.989093 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:36.989154 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":121,"threads_started":1}
I20260808 05:57:37.195057 19605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:37.194511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:44837)
0808 05:57:37.194853 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:37.194930 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":94,"threads_started":1}
I20260808 05:57:37.831027 19606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:37.830486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:57181)
0808 05:57:37.830780 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:37.830848 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":94,"threads_started":1}
I20260808 05:57:37.941164 19607 raft_consensus.cc:482] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:37.941303 19607 raft_consensus.cc:504] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:37.941751 19607 leader_election.cc:288] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953), 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
W20260808 05:57:37.942627 19184 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
W20260808 05:57:37.942724 19185 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
I20260808 05:57:37.942833 19185 leader_election.cc:302] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d924f4d80f924cdba4b5d368296f8bae; no voters: 5689ee6bf4c446d4991c1f6e39c53b38, eb8359ef71f540cdaefd35b733eb3220
I20260808 05:57:37.943027 19607 raft_consensus.cc:2726] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:57:37.990439 19608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:37.989955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:37599)
0808 05:57:37.990268 (+ 313us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:37.990325 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":100,"threads_started":1}
I20260808 05:57:38.196506 19609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:38.195980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:58753)
0808 05:57:38.196301 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:38.196377 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":85,"threads_started":1}
I20260808 05:57:38.832412 19610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:38.831888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:35081)
0808 05:57:38.832242 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:38.832306 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":93,"threads_started":1}
I20260808 05:57:38.991822 19611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:38.991335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:56015)
0808 05:57:38.991637 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:38.991710 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":214,"thread_start_us":86,"threads_started":1}
I20260808 05:57:39.197852 19612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:39.197356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:36265)
0808 05:57:39.197677 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:39.197745 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":82,"threads_started":1}
I20260808 05:57:39.554853 19613 raft_consensus.cc:482] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:39.555039 19613 raft_consensus.cc:504] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:39.555583 19613 leader_election.cc:288] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953), 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
W20260808 05:57:39.556464 19185 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
W20260808 05:57:39.556701 19184 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
I20260808 05:57:39.556835 19184 leader_election.cc:302] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d924f4d80f924cdba4b5d368296f8bae; no voters: 5689ee6bf4c446d4991c1f6e39c53b38, eb8359ef71f540cdaefd35b733eb3220
I20260808 05:57:39.557024 19613 raft_consensus.cc:2726] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:57:39.833863 19615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:39.833356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:49731)
0808 05:57:39.833700 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:39.833759 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":268,"thread_start_us":126,"threads_started":1}
I20260808 05:57:39.993343 19616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:39.992899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:37333)
0808 05:57:39.993173 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:39.993236 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":79,"threads_started":1}
I20260808 05:57:40.199103 19617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:40.198665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:57179)
0808 05:57:40.198943 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:40.199003 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":82,"threads_started":1}
I20260808 05:57:40.835009 19618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:40.834616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:45937)
0808 05:57:40.834857 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:40.834910 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":77,"threads_started":1}
I20260808 05:57:40.994732 19619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:40.994255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:46689)
0808 05:57:40.994563 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:40.994630 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":216,"thread_start_us":82,"threads_started":1}
I20260808 05:57:41.200359 19620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:41.199921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:36179)
0808 05:57:41.200200 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:41.200261 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":89,"threads_started":1}
I20260808 05:57:41.744470 19621 raft_consensus.cc:482] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:41.744635 19621 raft_consensus.cc:504] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:41.745164 19621 leader_election.cc:288] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953), 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
W20260808 05:57:41.746001 19185 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
W20260808 05:57:41.746136 19184 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
I20260808 05:57:41.746258 19184 leader_election.cc:302] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d924f4d80f924cdba4b5d368296f8bae; no voters: 5689ee6bf4c446d4991c1f6e39c53b38, eb8359ef71f540cdaefd35b733eb3220
I20260808 05:57:41.746429 19621 raft_consensus.cc:2726] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:57:41.836561 19622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:41.836067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:35175)
0808 05:57:41.836397 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:41.836462 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":107,"threads_started":1}
I20260808 05:57:41.996133 19623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:41.995614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:46107)
0808 05:57:41.995961 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:41.996025 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":82,"threads_started":1}
I20260808 05:57:42.201678 19624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:42.201188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:57987)
0808 05:57:42.201504 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:42.201579 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":239,"thread_start_us":78,"threads_started":1}
I20260808 05:57:42.837918 19625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:42.837464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:45631)
0808 05:57:42.837757 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:42.837818 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":212,"thread_start_us":106,"threads_started":1}
I20260808 05:57:42.997452 19626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:42.996987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:48441)
0808 05:57:42.997292 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:42.997351 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":87,"threads_started":1}
I20260808 05:57:43.203258 19627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:43.202729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:36383)
0808 05:57:43.203085 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:43.203155 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":94,"threads_started":1}
I20260808 05:57:43.839362 19628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:43.838890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:39335)
0808 05:57:43.839213 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:43.839266 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":101,"threads_started":1}
I20260808 05:57:43.998716 19629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:43.998274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:58491)
0808 05:57:43.998552 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:43.998616 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":92,"threads_started":1}
I20260808 05:57:44.204880 19630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:44.204329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:43363)
0808 05:57:44.204651 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:44.204719 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":94,"threads_started":1}
I20260808 05:57:44.841015 19632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:44.840402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:48823)
0808 05:57:44.840781 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:44.840850 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":237,"thread_start_us":103,"threads_started":1}
I20260808 05:57:45.000103 19633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:44.999624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:50791)
0808 05:57:44.999910 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:44.999975 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":83,"threads_started":1}
I20260808 05:57:45.206282 19634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:45.205781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:32851)
0808 05:57:45.206107 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:45.206176 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":240,"thread_start_us":87,"threads_started":1}
I20260808 05:57:45.842386 19635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:45.841859 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:34465)
0808 05:57:45.842192 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:45.842257 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":94,"threads_started":1}
I20260808 05:57:46.001710 19636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:46.001209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:46167)
0808 05:57:46.001529 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:46.001596 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":80,"threads_started":1}
I20260808 05:57:46.050113 19637 raft_consensus.cc:482] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:46.050263 19637 raft_consensus.cc:504] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb8359ef71f540cdaefd35b733eb3220" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41953 } } peers { permanent_uuid: "d924f4d80f924cdba4b5d368296f8bae" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38691 } } peers { permanent_uuid: "5689ee6bf4c446d4991c1f6e39c53b38" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 34581 } }
I20260808 05:57:46.050700 19637 leader_election.cc:288] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953), 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581)
W20260808 05:57:46.051542 19184 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer eb8359ef71f540cdaefd35b733eb3220 (127.2.191.67:41953): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
W20260808 05:57:46.051644 19185 leader_election.cc:341] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 5689ee6bf4c446d4991c1f6e39c53b38 (127.2.191.66:34581): Not found: Tablet not found: d8815ccc35b048738375c78265c57af2
I20260808 05:57:46.051710 19185 leader_election.cc:302] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d924f4d80f924cdba4b5d368296f8bae; no voters: 5689ee6bf4c446d4991c1f6e39c53b38, eb8359ef71f540cdaefd35b733eb3220
I20260808 05:57:46.051849 19637 raft_consensus.cc:2726] T d8815ccc35b048738375c78265c57af2 P d924f4d80f924cdba4b5d368296f8bae [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:57:46.207620 19638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:46.207119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:44925)
0808 05:57:46.207442 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:46.207514 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":86,"threads_started":1}
I20260808 05:57:46.843943 19639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:46.843422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:33231)
0808 05:57:46.843733 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:46.843804 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":107,"threads_started":1}
I20260808 05:57:47.003051 19640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:47.002553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:60041)
0808 05:57:47.002865 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:47.002945 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":94,"threads_started":1}
I20260808 05:57:47.209208 19641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:47.208623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:57007)
0808 05:57:47.209006 (+ 383us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:47.209083 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":150,"threads_started":1}
I20260808 05:57:47.845394 19642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:47.844922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:40761)
0808 05:57:47.845231 (+ 309us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:47.845294 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":101,"threads_started":1}
I20260808 05:57:48.004588 19643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:48.004072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:45433)
0808 05:57:48.004379 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:48.004442 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":97,"threads_started":1}
I20260808 05:57:48.210618 19644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:48.210037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:47461)
0808 05:57:48.210425 (+ 388us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:48.210491 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":98,"threads_started":1}
I20260808 05:57:48.846692 19645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:48.846272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:55079)
0808 05:57:48.846525 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:48.846592 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":79,"threads_started":1}
I20260808 05:57:49.006074 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:49.005575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:52947)
0808 05:57:49.005895 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:49.005962 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":89,"threads_started":1}
I20260808 05:57:49.212097 19647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:49.211576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.67:39209)
0808 05:57:49.211906 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:49.211971 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":115,"threads_started":1}
I20260808 05:57:49.848122 19648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:49.847670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.65:55739)
0808 05:57:49.847936 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:49.847992 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":95,"threads_started":1}
I20260808 05:57:50.007530 19649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:50.007042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44283 (local address 127.2.191.66:56907)
0808 05:57:50.007359 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:50.007425 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:44283: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":96,"threads_started":1}
I20260808 05:57:50.196400 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 19128
I20260808 05:57:50.204541 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 19306
I20260808 05:57:50.211887 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 19451
2026-08-08T05:57:50Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (19548 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:57:50 dist-test-slave-qg60 krb5kdc[19652](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:57:50 dist-test-slave-qg60 krb5kdc[19652](info): set up 2 sockets
Aug 08 05:57:50 dist-test-slave-qg60 krb5kdc[19652](info): commencing operation
krb5kdc: starting...
W20260808 05:57:51.329349 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:57:51 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:57:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:57:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:57:51.467725 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33231
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:33231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:51.583652 19667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:51.583976 19667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:51.584059 19667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:51.588217 19667 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:57:51.588310 19667 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:57:51.588337 19667 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:57:51.588359 19667 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:57:51.588402 19667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:51.588440 19667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:51.588495 19667 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:57:51.588536 19667 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:57:51.594179 19667 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:33231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:51.595372 19667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:51.596449 19667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:51.605939 19672 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:51.605891 19675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:51.605901 19667 server_base.cc:1034] running on GCE node
W20260808 05:57:51.605903 19673 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:51.606921 19667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:51.608215 19667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:51.609398 19667 hybrid_clock.cc:648] HybridClock initialized: now 1786168671609353 us; error 54 us; skew 500 ppm
Aug 08 05:57:51 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168671, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:51.612315 19667 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:57:51.613356 19667 webserver.cc:460] Webserver started at http://127.2.191.126:40939/ using document root <none> and password file <none>
I20260808 05:57:51.614006 19667 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:51.614076 19667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:51.614362 19667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:51.616547 19667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "24d56561caa643c78992913ca50ad101"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "ce6317e1238fc39b53d85665461054f4"
server_key_iv: "0716a5c34216d47cf5e0a4fa5bb45718"
server_key_version: "encryptionkey@0"
I20260808 05:57:51.617236 19667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "24d56561caa643c78992913ca50ad101"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "ce6317e1238fc39b53d85665461054f4"
server_key_iv: "0716a5c34216d47cf5e0a4fa5bb45718"
server_key_version: "encryptionkey@0"
I20260808 05:57:51.621201 19667 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:57:51.623873 19683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:51.625329 19667 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:57:51.625487 19667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "24d56561caa643c78992913ca50ad101"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "ce6317e1238fc39b53d85665461054f4"
server_key_iv: "0716a5c34216d47cf5e0a4fa5bb45718"
server_key_version: "encryptionkey@0"
I20260808 05:57:51.625651 19667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:51.639710 19667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:51.642927 19667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:51.643158 19667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:51.650609 19667 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:33231
I20260808 05:57:51.650905 19738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:33231 every 8 connection(s)
I20260808 05:57:51.651662 19667 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:57:51.654544 19739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:51.655479 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 19667
I20260808 05:57:51.655637 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:57:51.655974 2813 external_mini_cluster.cc:1428] Setting key e4493dcb09a5e9b179f27c4f6c3a7ede
I20260808 05:57:51.661721 19739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Bootstrap starting.
I20260808 05:57:51.664636 19739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Neither blocks nor log segments found. Creating new log.
Aug 08 05:57:51 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168671, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:51.665570 19739 log.cc:824] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:51.668030 19739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: No bootstrap required, opened a new log
I20260808 05:57:51.671355 19742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:51.657466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46628 (local address 127.2.191.126:33231)
0808 05:57:51.657945 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:51.657961 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:51.657999 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:57:51.658690 (+ 691us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:51.658708 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:51.659047 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:51.659357 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:51.660341 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:51.661457 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:51.662578 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:51.663038 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:51.663206 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:51.666182 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:51.666187 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:51.666201 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:51.666227 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:51.668150 (+ 1923us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:51.668593 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:51.668599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:51.668604 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:51.668774 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:51.669054 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:51.669057 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:51.669059 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:51.669547 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:51.669762 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:51.669964 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 05:57:51.670281 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":320,"thread_start_us":152,"threads_started":1}
I20260808 05:57:51.672890 19739 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:57:51.673121 19739 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:51.673179 19739 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d56561caa643c78992913ca50ad101, State: Initialized, Role: FOLLOWER
I20260808 05:57:51.673625 19739 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:57:51.673799 19739 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:57:51.673899 19739 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:57:51.674010 19739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:51.674966 19739 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:57:51.675326 19739 leader_election.cc:302] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24d56561caa643c78992913ca50ad101; no voters:
I20260808 05:57:51.675649 19739 leader_election.cc:288] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:57:51.675796 19744 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:51.676059 19744 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 1 LEADER]: Becoming Leader. State: Replica: 24d56561caa643c78992913ca50ad101, State: Running, Role: LEADER
I20260808 05:57:51.676463 19744 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:57:51.677032 19739 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:57:51.678268 19746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24d56561caa643c78992913ca50ad101. Latest consensus state: current_term: 1 leader_uuid: "24d56561caa643c78992913ca50ad101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } } }
I20260808 05:57:51.678411 19746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:51.678709 19745 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24d56561caa643c78992913ca50ad101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } } }
I20260808 05:57:51.678808 19745 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: This master's current role is: LEADER
I20260808 05:57:51.678853 19754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:57:51.682201 19754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:57:51.688407 19754 catalog_manager.cc:1347] Generated new cluster ID: 0d82d14e65314627b683515b437f46ce
I20260808 05:57:51.688491 19754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:57:51.702735 19754 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:57:51.703722 19754 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:57:51.709254 19754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Generated new TSK 0
I20260808 05:57:51.709968 19754 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:57:51.747941 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33231
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:51.863910 19767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:51.864302 19767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:51.864396 19767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:51.868486 19767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:51.868589 19767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:51.868686 19767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:57:51.875597 19767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19767
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:51.876904 19767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:51.878151 19767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:51.888619 19773 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:51.888675 19767 server_base.cc:1034] running on GCE node
W20260808 05:57:51.888697 19775 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:51.888619 19772 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:51.889381 19767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:51.890128 19767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:51.891301 19767 hybrid_clock.cc:648] HybridClock initialized: now 1786168671891288 us; error 31 us; skew 500 ppm
Aug 08 05:57:51 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168671, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:51.894318 19767 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:57:51.895283 19767 webserver.cc:460] Webserver started at http://127.2.191.65:45933/ using document root <none> and password file <none>
I20260808 05:57:51.895816 19767 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:51.895877 19767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:51.896044 19767 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:51.898160 19767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "ff5a060eac4b46af98491d11cca69dfa"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "d38a69c99a3d604dc2848cb76e7a34bc"
server_key_iv: "2234de6db04db2f5b302d996b08171b2"
server_key_version: "encryptionkey@0"
I20260808 05:57:51.898690 19767 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "ff5a060eac4b46af98491d11cca69dfa"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "d38a69c99a3d604dc2848cb76e7a34bc"
server_key_iv: "2234de6db04db2f5b302d996b08171b2"
server_key_version: "encryptionkey@0"
I20260808 05:57:51.902498 19767 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:57:51.904944 19783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:51.906301 19767 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:57:51.906404 19767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "ff5a060eac4b46af98491d11cca69dfa"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "d38a69c99a3d604dc2848cb76e7a34bc"
server_key_iv: "2234de6db04db2f5b302d996b08171b2"
server_key_version: "encryptionkey@0"
I20260808 05:57:51.906502 19767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:51.916651 19767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:51.920086 19767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:51.920245 19767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:51.920847 19767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:51.921669 19767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:51.921720 19767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:51.921762 19767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:51.921777 19767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:51.931437 19767 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:39949
I20260808 05:57:51.931466 19907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:39949 every 8 connection(s)
I20260808 05:57:51.932399 19767 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:57:51.935942 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 19767
I20260808 05:57:51.936100 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:57:51.936429 2813 external_mini_cluster.cc:1428] Setting key f9a043e3b0174a67e8aea69d44501e96
Aug 08 05:57:51 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168671, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:57:51.947852 19742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:51.934510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:59971 (local address 127.2.191.126:33231)
0808 05:57:51.934679 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:51.934683 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:51.935867 (+ 1184us) server_negotiation.cc:407] Connection header received
0808 05:57:51.937039 (+ 1172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:51.937042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:51.937101 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:51.937216 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:51.938520 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:51.939071 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:51.940665 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:51.940971 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:51.941062 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:51.944019 (+ 2957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:51.944023 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:51.944027 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:51.944061 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:51.945656 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:51.946197 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:51.946200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:51.946202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:51.946290 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:51.946649 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:51.946654 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:51.946655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:51.946850 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:51.946962 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:51.947518 (+ 556us) server_negotiation.cc:299] Negotiation successful
0808 05:57:51.947671 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 05:57:51.948820 19910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:51.934971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:59971)
0808 05:57:51.935690 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:51.935734 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:51.936818 (+ 1084us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:51.937399 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:51.937406 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:51.937778 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:51.938355 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:51.938369 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:51.939206 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:51.939209 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:51.940504 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:51.940520 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:51.941134 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:51.941141 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:51.941375 (+ 234us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:51.942057 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:51.942082 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:51.943839 (+ 1757us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:51.945782 (+ 1943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:51.945789 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:51.945805 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:51.946087 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:51.946387 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:51.946390 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:51.946392 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:51.946545 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:51.946960 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:51.946967 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:51.947230 (+ 263us) client_negotiation.cc:769] Sending connection context
0808 05:57:51.947462 (+ 232us) client_negotiation.cc:240] Negotiation successful
0808 05:57:51.947812 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":117,"threads_started":1}
I20260808 05:57:51.950361 19908 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33231
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:57:51.950639 19908 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:51.951241 19908 heartbeater.cc:511] Master 127.2.191.126:33231 requested a full tablet report, sending...
I20260808 05:57:51.953087 19701 ts_manager.cc:194] Registered new tserver with Master: ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949)
I20260808 05:57:51.954272 19701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:59971
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:57:51.969372 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33231
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:52.092849 19913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:52.093268 19913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:52.093325 19913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:52.098083 19913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:52.098155 19913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:52.098223 19913 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:57:52.104171 19913 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:52.105315 19913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:52.106436 19913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:52.117100 19918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:52.117132 19919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:52.117120 19921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:52.117256 19913 server_base.cc:1034] running on GCE node
I20260808 05:57:52.117941 19913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:52.118647 19913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:52.119843 19913 hybrid_clock.cc:648] HybridClock initialized: now 1786168672119821 us; error 30 us; skew 500 ppm
Aug 08 05:57:52 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168672, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:52.122825 19913 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:57:52.123857 19913 webserver.cc:460] Webserver started at http://127.2.191.66:34499/ using document root <none> and password file <none>
I20260808 05:57:52.124423 19913 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:52.124485 19913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:52.124668 19913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:52.126988 19913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "8b40deb1d87444fa82480dc7882f09a6"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "07de454fb45e8053ab191fe0b5c12cdf"
server_key_iv: "2b2e72dfb97ca2a719607f8da167cb3c"
server_key_version: "encryptionkey@0"
I20260808 05:57:52.127559 19913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "8b40deb1d87444fa82480dc7882f09a6"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "07de454fb45e8053ab191fe0b5c12cdf"
server_key_iv: "2b2e72dfb97ca2a719607f8da167cb3c"
server_key_version: "encryptionkey@0"
I20260808 05:57:52.131899 19913 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 05:57:52.134465 19928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:52.135787 19913 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:57:52.135924 19913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "8b40deb1d87444fa82480dc7882f09a6"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "07de454fb45e8053ab191fe0b5c12cdf"
server_key_iv: "2b2e72dfb97ca2a719607f8da167cb3c"
server_key_version: "encryptionkey@0"
I20260808 05:57:52.136051 19913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:52.161290 19913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:52.164685 19913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:52.165074 19913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:52.165735 19913 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:52.166679 19913 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:52.166750 19913 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:52.166819 19913 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:52.166867 19913 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:52.177196 19913 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:40391
I20260808 05:57:52.177289 20047 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:40391 every 8 connection(s)
I20260808 05:57:52.178362 19913 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:57:52.187882 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 19913
I20260808 05:57:52.188083 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:57:52.188385 2813 external_mini_cluster.cc:1428] Setting key 2df46f659e74aa79813335ca9feb06f5
Aug 08 05:57:52 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168672, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:52.194669 19742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.180424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:60909 (local address 127.2.191.126:33231)
0808 05:57:52.180587 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.180591 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.181812 (+ 1221us) server_negotiation.cc:407] Connection header received
0808 05:57:52.183117 (+ 1305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.183122 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.183188 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.183296 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:52.184646 (+ 1350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.185319 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.186649 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.186911 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.187047 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.190287 (+ 3240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:52.190291 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:52.190294 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:52.190322 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:52.192156 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:52.192918 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:52.192921 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:52.192922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:52.193001 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:52.193439 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:52.193442 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:52.193443 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:52.193627 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:52.193705 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.194428 (+ 723us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.194542 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 05:57:52.195978 20050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.180893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:60909)
0808 05:57:52.181643 (+ 750us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:52.181688 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:52.182755 (+ 1067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:52.183510 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:52.183518 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:52.183937 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:52.184481 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.184495 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.185473 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.185477 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.186471 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.186482 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.187099 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.187104 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.187313 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.188057 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:52.188083 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:52.190091 (+ 2008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:52.192332 (+ 2241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:52.192341 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:52.192363 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:52.192808 (+ 445us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:52.193116 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:52.193121 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:52.193125 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:52.193328 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:52.193736 (+ 408us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:52.193745 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:52.194130 (+ 385us) client_negotiation.cc:769] Sending connection context
0808 05:57:52.194357 (+ 227us) client_negotiation.cc:240] Negotiation successful
0808 05:57:52.194745 (+ 388us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":156,"threads_started":1}
I20260808 05:57:52.197345 20048 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33231
I20260808 05:57:52.197618 20048 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:52.198163 20048 heartbeater.cc:511] Master 127.2.191.126:33231 requested a full tablet report, sending...
I20260808 05:57:52.199319 19701 ts_manager.cc:194] Registered new tserver with Master: 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391)
I20260808 05:57:52.199915 19701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:60909
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:57:52.220492 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33231
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:57:52.337009 20054 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:57:52.337314 20054 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:57:52.337395 20054 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:57:52.341732 20054 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:57:52.341836 20054 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:57:52.341936 20054 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:57:52.347436 20054 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20054
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:57:52.348601 20054 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:57:52.349754 20054 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:57:52.360163 20063 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:57:52.360163 20061 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:52.360204 20054 server_base.cc:1034] running on GCE node
W20260808 05:57:52.360163 20060 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:57:52.360910 20054 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:57:52.361634 20054 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:57:52.362809 20054 hybrid_clock.cc:648] HybridClock initialized: now 1786168672362794 us; error 32 us; skew 500 ppm
Aug 08 05:57:52 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168672, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:57:52.365965 20054 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:57:52.366955 20054 webserver.cc:460] Webserver started at http://127.2.191.67:38621/ using document root <none> and password file <none>
I20260808 05:57:52.367568 20054 fs_manager.cc:359] Metadata directory not provided
I20260808 05:57:52.367633 20054 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:57:52.367879 20054 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:57:52.370090 20054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "9803c7c9f699424ebf1a0abed7d42a93"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "2869789a2c5a7f9df1fc1fca1350fca1"
server_key_iv: "2f6d187a6ded8cf842a2b1ee584b3dd8"
server_key_version: "encryptionkey@0"
I20260808 05:57:52.370736 20054 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "9803c7c9f699424ebf1a0abed7d42a93"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "2869789a2c5a7f9df1fc1fca1350fca1"
server_key_iv: "2f6d187a6ded8cf842a2b1ee584b3dd8"
server_key_version: "encryptionkey@0"
I20260808 05:57:52.374917 20054 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:57:52.378096 20070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:52.379539 20054 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:57:52.379683 20054 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "9803c7c9f699424ebf1a0abed7d42a93"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "2869789a2c5a7f9df1fc1fca1350fca1"
server_key_iv: "2f6d187a6ded8cf842a2b1ee584b3dd8"
server_key_version: "encryptionkey@0"
I20260808 05:57:52.379812 20054 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:57:52.405488 20054 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:57:52.409332 20054 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:57:52.409607 20054 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:57:52.410355 20054 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:57:52.411355 20054 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:57:52.411410 20054 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:52.411494 20054 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:57:52.411543 20054 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:57:52.422123 20054 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:38411
I20260808 05:57:52.422142 20194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:38411 every 8 connection(s)
I20260808 05:57:52.423173 20054 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:57:52.428386 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 20054
I20260808 05:57:52.428565 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:57:52.428963 2813 external_mini_cluster.cc:1428] Setting key 024352b0067055b7dbd635e0397ad68b
Aug 08 05:57:52 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168672, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:57:52.438124 19742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.425293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:34063 (local address 127.2.191.126:33231)
0808 05:57:52.425446 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.425451 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.426519 (+ 1068us) server_negotiation.cc:407] Connection header received
0808 05:57:52.427457 (+ 938us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.427460 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.427514 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.427598 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:52.429040 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.429814 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.431496 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.431707 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.431795 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.434404 (+ 2609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:52.434407 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:52.434410 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:52.434435 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:52.435981 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:52.436568 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:52.436570 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:52.436571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:52.436649 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:52.437000 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:52.437002 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:52.437004 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:52.437207 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:52.437291 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.437819 (+ 528us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.437953 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:57:52.438895 20197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.425700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:34063)
0808 05:57:52.426360 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:52.426402 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:52.427229 (+ 827us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:52.427762 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:52.427769 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:52.428174 (+ 405us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:57:52.428784 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.428804 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.429947 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.429954 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.431372 (+ 1418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.431382 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.431841 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.431844 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.431979 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.432644 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:57:52.432661 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:57:52.434210 (+ 1549us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:57:52.436138 (+ 1928us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:52.436143 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:52.436157 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:52.436466 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:52.436773 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:57:52.436776 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:57:52.436777 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:57:52.436914 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:57:52.437303 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:57:52.437308 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:57:52.437541 (+ 233us) client_negotiation.cc:769] Sending connection context
0808 05:57:52.437715 (+ 174us) client_negotiation.cc:240] Negotiation successful
0808 05:57:52.437988 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":113,"threads_started":1}
I20260808 05:57:52.440140 20195 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33231
I20260808 05:57:52.440418 20195 heartbeater.cc:464] Registering TS with master...
I20260808 05:57:52.440991 20195 heartbeater.cc:511] Master 127.2.191.126:33231 requested a full tablet report, sending...
I20260808 05:57:52.442168 19701 ts_manager.cc:194] Registered new tserver with Master: 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
I20260808 05:57:52.442893 19701 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:34063
I20260808 05:57:52.443138 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:57:52.452651 19742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.445365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46640 (local address 127.2.191.126:33231)
0808 05:57:52.445531 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.445534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.445712 (+ 178us) server_negotiation.cc:407] Connection header received
0808 05:57:52.445802 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.445804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.445842 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.445906 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:57:52.446554 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.447078 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.447882 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.448120 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.448204 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.449650 (+ 1446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:57:52.449653 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:57:52.449655 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:57:52.449677 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:57:52.451142 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:52.451553 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:52.451556 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:52.451557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:52.451633 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:57:52.451858 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:57:52.451860 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:57:52.451862 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:57:52.452099 (+ 237us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:57:52.452209 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.452409 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.452502 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 05:57:52.455677 19701 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:57:52.458806 19701 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:57:52.474141 20210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.468387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41218 (local address 127.2.191.65:39949)
0808 05:57:52.468883 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.468892 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.468935 (+ 43us) server_negotiation.cc:407] Connection header received
0808 05:57:52.469015 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.469019 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.469223 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.469578 (+ 355us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:52.469795 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.471001 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.472549 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.473366 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.473707 (+ 341us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.473839 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.473896 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.473986 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":100,"threads_started":1}
I20260808 05:57:52.474138 20206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.467437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:40391 (local address 127.0.0.1:38656)
0808 05:57:52.467807 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:52.467862 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:52.467991 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:52.469405 (+ 1414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:52.469412 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:52.469443 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:52.469867 (+ 424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.469874 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.471277 (+ 1403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.471281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.472362 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.472372 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.473706 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.473709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.473793 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.473812 (+ 19us) client_negotiation.cc:769] Sending connection context
0808 05:57:52.473890 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:57:52.473966 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":50,"spinlock_wait_cycles":768,"thread_start_us":107,"threads_started":1}
I20260808 05:57:52.474146 20208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.468186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39949 (local address 127.0.0.1:41218)
0808 05:57:52.468489 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:52.468502 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:52.468600 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:52.469405 (+ 805us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:52.469412 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:52.469452 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:52.469678 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.469685 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.471124 (+ 1439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.471127 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.472409 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.472420 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.473514 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.473518 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.473638 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.473704 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 05:57:52.473793 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:57:52.473953 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":136,"spinlock_wait_cycles":4480,"thread_start_us":104,"threads_started":1}
I20260808 05:57:52.474144 20209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.467690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:38411 (local address 127.0.0.1:58164)
0808 05:57:52.468473 (+ 783us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:52.468487 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:52.468586 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:52.469676 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:52.469679 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:52.469697 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:52.469814 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.469821 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.470945 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.470949 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.472620 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.472631 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.473499 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.473503 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.473625 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.473687 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 05:57:52.473797 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 05:57:52.473953 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":719,"mutex_wait_us":90,"thread_start_us":112,"threads_started":1}
I20260808 05:57:52.474501 20211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.468319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58164 (local address 127.2.191.67:38411)
0808 05:57:52.469159 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.469179 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.469204 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:57:52.469283 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.469288 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.469516 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.469962 (+ 446us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:52.470103 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.470805 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.472788 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.473359 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.473496 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.473642 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.474214 (+ 572us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.474321 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":182,"threads_started":1}
I20260808 05:57:52.474853 20207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.467587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38656 (local address 127.2.191.66:40391)
0808 05:57:52.468883 (+ 1296us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.468904 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.468941 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:57:52.469014 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.469019 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.469223 (+ 204us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.469534 (+ 311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:52.470004 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.471142 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.472486 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.473366 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.473488 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.473643 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.474574 (+ 931us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.474693 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1188,"thread_start_us":120,"threads_started":1}
I20260808 05:57:52.477425 20124 tablet_service.cc:1467] Processing CreateTablet for tablet d03877100a984be8a787c08d782061d1 (DEFAULT_TABLE table=test-table [id=09526594ceb346e9891f4d77dd2b28ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:52.477686 19838 tablet_service.cc:1467] Processing CreateTablet for tablet d03877100a984be8a787c08d782061d1 (DEFAULT_TABLE table=test-table [id=09526594ceb346e9891f4d77dd2b28ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:52.477736 19981 tablet_service.cc:1467] Processing CreateTablet for tablet d03877100a984be8a787c08d782061d1 (DEFAULT_TABLE table=test-table [id=09526594ceb346e9891f4d77dd2b28ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:57:52.478572 20124 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d03877100a984be8a787c08d782061d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:52.478765 19838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d03877100a984be8a787c08d782061d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:52.478765 19981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d03877100a984be8a787c08d782061d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:57:52.485157 20212 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: Bootstrap starting.
I20260808 05:57:52.486598 20213 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Bootstrap starting.
I20260808 05:57:52.488389 20212 tablet_bootstrap.cc:654] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:52.488705 20213 tablet_bootstrap.cc:654] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:52.489084 20214 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: Bootstrap starting.
I20260808 05:57:52.489719 20212 log.cc:824] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:52.489719 20213 log.cc:824] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:52.491554 20214 tablet_bootstrap.cc:654] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: Neither blocks nor log segments found. Creating new log.
I20260808 05:57:52.491614 20213 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: No bootstrap required, opened a new log
I20260808 05:57:52.491817 20213 ts_tablet_manager.cc:1397] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s
I20260808 05:57:52.492058 20212 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: No bootstrap required, opened a new log
I20260808 05:57:52.492304 20212 ts_tablet_manager.cc:1397] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.005s
I20260808 05:57:52.492417 20214 log.cc:824] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:57:52.494467 20214 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: No bootstrap required, opened a new log
I20260808 05:57:52.494652 20214 ts_tablet_manager.cc:1397] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: Time spent bootstrapping tablet: real 0.006s user 0.000s sys 0.004s
I20260808 05:57:52.495857 20213 raft_consensus.cc:348] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.496122 20213 raft_consensus.cc:374] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:52.496176 20213 raft_consensus.cc:729] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff5a060eac4b46af98491d11cca69dfa, State: Initialized, Role: FOLLOWER
I20260808 05:57:52.496224 20212 raft_consensus.cc:348] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.496485 20212 raft_consensus.cc:374] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:52.496543 20212 raft_consensus.cc:729] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9803c7c9f699424ebf1a0abed7d42a93, State: Initialized, Role: FOLLOWER
I20260808 05:57:52.496658 20213 consensus_queue.cc:260] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.496996 20212 consensus_queue.cc:260] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.497449 19908 heartbeater.cc:503] Master 127.2.191.126:33231 was elected leader, sending a full tablet report...
I20260808 05:57:52.497821 20213 ts_tablet_manager.cc:1428] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 05:57:52.497969 20212 ts_tablet_manager.cc:1428] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20260808 05:57:52.498589 20195 heartbeater.cc:503] Master 127.2.191.126:33231 was elected leader, sending a full tablet report...
I20260808 05:57:52.498435 20214 raft_consensus.cc:348] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.498683 20214 raft_consensus.cc:374] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:57:52.498734 20214 raft_consensus.cc:729] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b40deb1d87444fa82480dc7882f09a6, State: Initialized, Role: FOLLOWER
I20260808 05:57:52.499145 20214 consensus_queue.cc:260] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.500062 20214 ts_tablet_manager.cc:1428] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260808 05:57:52.500386 20048 heartbeater.cc:503] Master 127.2.191.126:33231 was elected leader, sending a full tablet report...
I20260808 05:57:52.594699 20220 raft_consensus.cc:482] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:57:52.594906 20220 raft_consensus.cc:504] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.596156 20220 leader_election.cc:288] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949), 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
I20260808 05:57:52.601569 20210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.596626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:33327 (local address 127.2.191.65:39949)
0808 05:57:52.596783 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.596788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.596816 (+ 28us) server_negotiation.cc:407] Connection header received
0808 05:57:52.596881 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.596884 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.596925 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.597045 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:52.597374 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.598190 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.600119 (+ 1929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.600807 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.600938 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.600996 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.601352 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.601432 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:57:52.601568 20211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.596670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:46237 (local address 127.2.191.67:38411)
0808 05:57:52.596816 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.596821 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.597011 (+ 190us) server_negotiation.cc:407] Connection header received
0808 05:57:52.597135 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.597141 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.597195 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.597258 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:57:52.597521 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.598235 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.600114 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.600801 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.600938 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.600996 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.601352 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.601432 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 05:57:52.601619 20050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.596367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39949 (local address 127.2.191.66:33327)
0808 05:57:52.596515 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:52.596533 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:52.596643 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:52.597085 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:52.597088 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:52.597106 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:52.597218 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.597223 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.598347 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.598351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.599938 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.599951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.600992 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.600996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.601164 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.601223 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 05:57:52.601321 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 05:57:52.601423 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":233}
I20260808 05:57:52.601845 20221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.596467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:38411 (local address 127.2.191.66:46237)
0808 05:57:52.596902 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:52.596913 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:52.597003 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:57:52.597299 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:57:52.597304 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:57:52.597326 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:57:52.597419 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.597424 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.598347 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.598351 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.599938 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:57:52.599951 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.600992 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.600996 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:57:52.601147 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.601220 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 05:57:52.601321 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 05:57:52.601423 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":381,"mutex_wait_us":204,"thread_start_us":161,"threads_started":1}
I20260808 05:57:52.602425 19859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d03877100a984be8a787c08d782061d1" candidate_uuid: "8b40deb1d87444fa82480dc7882f09a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff5a060eac4b46af98491d11cca69dfa" is_pre_election: true
I20260808 05:57:52.602730 20145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d03877100a984be8a787c08d782061d1" candidate_uuid: "8b40deb1d87444fa82480dc7882f09a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9803c7c9f699424ebf1a0abed7d42a93" is_pre_election: true
I20260808 05:57:52.602787 19859 raft_consensus.cc:2454] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b40deb1d87444fa82480dc7882f09a6 in term 0.
I20260808 05:57:52.603018 20145 raft_consensus.cc:2454] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8b40deb1d87444fa82480dc7882f09a6 in term 0.
I20260808 05:57:52.603426 19932 leader_election.cc:302] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b40deb1d87444fa82480dc7882f09a6, ff5a060eac4b46af98491d11cca69dfa; no voters:
I20260808 05:57:52.603766 20220 raft_consensus.cc:2781] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:57:52.603878 20220 raft_consensus.cc:482] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:57:52.603947 20220 raft_consensus.cc:3037] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:52.605214 20220 raft_consensus.cc:504] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.605613 20220 leader_election.cc:288] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [CANDIDATE]: Term 1 election: Requested vote from peers ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949), 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
I20260808 05:57:52.606009 20145 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d03877100a984be8a787c08d782061d1" candidate_uuid: "8b40deb1d87444fa82480dc7882f09a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9803c7c9f699424ebf1a0abed7d42a93"
I20260808 05:57:52.606005 19859 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d03877100a984be8a787c08d782061d1" candidate_uuid: "8b40deb1d87444fa82480dc7882f09a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff5a060eac4b46af98491d11cca69dfa"
I20260808 05:57:52.606133 20145 raft_consensus.cc:3037] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:52.606164 19859 raft_consensus.cc:3037] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:57:52.607326 20145 raft_consensus.cc:2454] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b40deb1d87444fa82480dc7882f09a6 in term 1.
I20260808 05:57:52.607378 19859 raft_consensus.cc:2454] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8b40deb1d87444fa82480dc7882f09a6 in term 1.
I20260808 05:57:52.607722 19929 leader_election.cc:302] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b40deb1d87444fa82480dc7882f09a6, 9803c7c9f699424ebf1a0abed7d42a93; no voters:
I20260808 05:57:52.607972 20220 raft_consensus.cc:2781] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:57:52.608266 20220 raft_consensus.cc:686] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 LEADER]: Becoming Leader. State: Replica: 8b40deb1d87444fa82480dc7882f09a6, State: Running, Role: LEADER
I20260808 05:57:52.608692 20220 consensus_queue.cc:237] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:57:52.612387 19700 catalog_manager.cc:5495] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66). New cstate: current_term: 1 leader_uuid: "8b40deb1d87444fa82480dc7882f09a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } health_report { overall_health: UNKNOWN } } }
I20260808 05:57:52.632145 20207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:57:52.628174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38670 (local address 127.2.191.66:40391)
0808 05:57:52.628326 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 05:57:52.628331 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:57:52.628346 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:57:52.628492 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:57:52.628494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:57:52.628550 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:57:52.628682 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:57:52.629028 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.629631 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.630656 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:57:52.630874 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:57:52.630978 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:57:52.631310 (+ 332us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:57:52.631740 (+ 430us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:57:52.631879 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 05:57:52.631921 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 05:57:52.631979 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 05:57:52.638440 20145 raft_consensus.cc:1261] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 FOLLOWER]: Refusing update from remote peer 8b40deb1d87444fa82480dc7882f09a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:52.638490 19859 raft_consensus.cc:1261] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Refusing update from remote peer 8b40deb1d87444fa82480dc7882f09a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:57:52.639217 20220 consensus_queue.cc:1035] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:52.639437 20222 consensus_queue.cc:1035] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:57:52.649461 20226 mvcc.cc:205] Tried to move back new op lower bound from 7316146883118813184 to 7316146883008348160. Current Snapshot: MvccSnapshot[applied={T|T < 7316146883118813184}]
I20260808 05:57:52.658382 19701 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:57:52.658592 19701 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:57:52.661432 19701 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Sending DeleteTablet for 3 replicas of tablet d03877100a984be8a787c08d782061d1
I20260808 05:57:52.662385 19838 tablet_service.cc:1514] Processing DeleteTablet for tablet d03877100a984be8a787c08d782061d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:41218
I20260808 05:57:52.662437 20124 tablet_service.cc:1514] Processing DeleteTablet for tablet d03877100a984be8a787c08d782061d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:58164
I20260808 05:57:52.663061 19981 tablet_service.cc:1514] Processing DeleteTablet for tablet d03877100a984be8a787c08d782061d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:38656
I20260808 05:57:52.663133 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 19767
I20260808 05:57:52.666481 20240 tablet_replica.cc:330] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: stopping tablet replica
I20260808 05:57:52.666885 20240 raft_consensus.cc:2229] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:57:52.667490 20240 raft_consensus.cc:2258] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:52.668985 20238 tablet_replica.cc:330] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: stopping tablet replica
I20260808 05:57:52.669225 20240 ts_tablet_manager.cc:1905] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:52.669298 20238 raft_consensus.cc:2229] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:57:52.669649 20238 raft_consensus.cc:2258] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:57:52.672039 20238 ts_tablet_manager.cc:1905] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:57:52.673259 20240 ts_tablet_manager.cc:1918] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:52.673413 20240 log.cc:1196] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/d03877100a984be8a787c08d782061d1
I20260808 05:57:52.673834 20240 ts_tablet_manager.cc:1939] T d03877100a984be8a787c08d782061d1 P 8b40deb1d87444fa82480dc7882f09a6: Deleting consensus metadata
I20260808 05:57:52.674954 20238 ts_tablet_manager.cc:1918] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:57:52.675051 20238 log.cc:1196] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/d03877100a984be8a787c08d782061d1
W20260808 05:57:52.675284 19688 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:39949 (error 108)
I20260808 05:57:52.675740 20238 ts_tablet_manager.cc:1939] T d03877100a984be8a787c08d782061d1 P 9803c7c9f699424ebf1a0abed7d42a93: Deleting consensus metadata
I20260808 05:57:52.675843 19688 catalog_manager.cc:4841] TS 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391): tablet d03877100a984be8a787c08d782061d1 (table test-table [id=09526594ceb346e9891f4d77dd2b28ee]) successfully deleted
W20260808 05:57:52.676528 20206 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:57:52.676181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39949 (local address 127.0.0.1:41230)
0808 05:57:52.676310 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 05:57:52.676328 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:57:52.676403 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:39949: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 05:57:52.676699 19688 catalog_manager.cc:4584] TS ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d03877100a984be8a787c08d782061d1: Network error: Client connection negotiation failed: client connection to 127.2.191.65:39949: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260808 05:57:52.676784 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 19913
I20260808 05:57:52.680617 19685 catalog_manager.cc:4841] TS 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411): tablet d03877100a984be8a787c08d782061d1 (table test-table [id=09526594ceb346e9891f4d77dd2b28ee]) successfully deleted
I20260808 05:57:52.691319 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 20054
I20260808 05:57:52.699540 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 19667
I20260808 05:58:12.709360 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33231
--webserver_interface=127.2.191.126
--webserver_port=40939
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:33231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:12.829895 20242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:12.830219 20242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:12.830299 20242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:12.834399 20242 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:58:12.834477 20242 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:58:12.834504 20242 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:58:12.834528 20242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:58:12.834594 20242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:12.834636 20242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:12.834685 20242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:58:12.834725 20242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:58:12.840170 20242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:33231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=40939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:12.841467 20242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:12.842522 20242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:12.857899 20251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:12.857937 20248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:12.857899 20249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:12.857949 20242 server_base.cc:1034] running on GCE node
I20260808 05:58:12.858898 20242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:12.860283 20242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:12.861481 20242 hybrid_clock.cc:648] HybridClock initialized: now 1786168692861468 us; error 36 us; skew 500 ppm
Aug 08 05:58:12 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168692, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:12.869637 20242 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:58:12.870684 20242 webserver.cc:460] Webserver started at http://127.2.191.126:40939/ using document root <none> and password file <none>
I20260808 05:58:12.871309 20242 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:12.871423 20242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:12.875586 20242 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:58:12.878077 20259 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:12.879334 20242 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:58:12.879489 20242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "24d56561caa643c78992913ca50ad101"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "ce6317e1238fc39b53d85665461054f4"
server_key_iv: "0716a5c34216d47cf5e0a4fa5bb45718"
server_key_version: "encryptionkey@0"
I20260808 05:58:12.880131 20242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:12.892324 20242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:12.895926 20242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:12.896169 20242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:12.904022 20242 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:33231
I20260808 05:58:12.904371 20318 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:33231 every 8 connection(s)
I20260808 05:58:12.905287 20242 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:58:12.907732 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 20242
I20260808 05:58:12.908188 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:39949
--local_ip_for_outbound_sockets=127.2.191.65
--tserver_master_addrs=127.2.191.126:33231
--webserver_port=45933
--webserver_interface=127.2.191.65
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:58:12.910665 20319 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:58:12.913405 20319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Bootstrap starting.
I20260808 05:58:12.936318 20319 log.cc:824] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:12.945659 20319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:58:12.946065 20319 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Bootstrap complete.
I20260808 05:58:12.950379 20319 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:58:12.950837 20319 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d56561caa643c78992913ca50ad101, State: Initialized, Role: FOLLOWER
I20260808 05:58:12.951398 20319 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:58:12.951550 20319 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:58:12.951649 20319 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:58:12.951768 20319 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:58:12.953914 20319 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:58:12.954267 20319 leader_election.cc:302] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24d56561caa643c78992913ca50ad101; no voters:
I20260808 05:58:12.954674 20319 leader_election.cc:288] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:58:12.954833 20323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:58:12.955104 20323 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 2 LEADER]: Becoming Leader. State: Replica: 24d56561caa643c78992913ca50ad101, State: Running, Role: LEADER
I20260808 05:58:12.955518 20323 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:58:12.955987 20319 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:58:12.956621 20323 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24d56561caa643c78992913ca50ad101. Latest consensus state: current_term: 2 leader_uuid: "24d56561caa643c78992913ca50ad101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } } }
I20260808 05:58:12.956765 20323 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:12.957197 20328 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:58:12.959388 20324 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "24d56561caa643c78992913ca50ad101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } } }
I20260808 05:58:12.959586 20324 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:12.962353 20328 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:58:12.963143 20328 catalog_manager.cc:1259] Loaded cluster ID: 0d82d14e65314627b683515b437f46ce
I20260808 05:58:12.963230 20328 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:58:12.966265 20328 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:58:12.967060 20328 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Loaded TSK: 0
I20260808 05:58:12.980161 20328 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Generated new TSK 1
I20260808 05:58:12.980470 20328 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:58:13.052019 20321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:13.052312 20321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:13.052359 20321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:13.056865 20321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:13.056937 20321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:13.057040 20321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:58:13.062752 20321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:39949
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=45933
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:13.063848 20321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:13.064980 20321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:13.074927 20350 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:13.074887 20347 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:13.074875 20348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:13.075179 20321 server_base.cc:1034] running on GCE node
I20260808 05:58:13.075663 20321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:13.076526 20321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:13.077711 20321 hybrid_clock.cc:648] HybridClock initialized: now 1786168693077706 us; error 63 us; skew 500 ppm
Aug 08 05:58:13 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168693, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:13.080543 20321 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:58:13.081550 20321 webserver.cc:460] Webserver started at http://127.2.191.65:45933/ using document root <none> and password file <none>
I20260808 05:58:13.082115 20321 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:13.082190 20321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:13.086565 20321 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:58:13.089126 20357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:13.090480 20321 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 05:58:13.090592 20321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "ff5a060eac4b46af98491d11cca69dfa"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "d38a69c99a3d604dc2848cb76e7a34bc"
server_key_iv: "2234de6db04db2f5b302d996b08171b2"
server_key_version: "encryptionkey@0"
I20260808 05:58:13.091195 20321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:13.115844 20321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:13.118950 20321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:13.119184 20321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:13.119849 20321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:13.121028 20364 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:58:13.125268 20321 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:58:13.125339 20321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.005s user 0.000s sys 0.000s
I20260808 05:58:13.125423 20321 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:58:13.127179 20321 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:58:13.127225 20321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 05:58:13.127513 20364 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Bootstrap starting.
I20260808 05:58:13.138073 20321 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:39949
I20260808 05:58:13.138151 20481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:39949 every 8 connection(s)
I20260808 05:58:13.139053 20321 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:58:13.147626 20364 log.cc:824] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:13.149097 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 20321
I20260808 05:58:13.149638 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:40391
--local_ip_for_outbound_sockets=127.2.191.66
--tserver_master_addrs=127.2.191.126:33231
--webserver_port=34499
--webserver_interface=127.2.191.66
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:58:13 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168693, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:13.156682 20364 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:58:13.157202 20364 tablet_bootstrap.cc:492] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Bootstrap complete.
I20260808 05:58:13.158344 20485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.141050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:34359)
0808 05:58:13.141704 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:13.141757 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:13.142573 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:13.143997 (+ 1424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:13.144006 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:13.144478 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:13.145020 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.145035 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.146930 (+ 1895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.146932 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.147938 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.147948 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.149005 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.149009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.149190 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.149944 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:13.149966 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:13.151470 (+ 1504us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:13.154424 (+ 2954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:13.154430 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:13.154443 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:13.154813 (+ 370us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:13.155282 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:13.155285 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:13.155287 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:13.155461 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:13.156284 (+ 823us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:13.156292 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:13.156585 (+ 293us) client_negotiation.cc:769] Sending connection context
0808 05:58:13.156849 (+ 264us) client_negotiation.cc:240] Negotiation successful
0808 05:58:13.157255 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":143,"threads_started":1}
I20260808 05:58:13.158659 20364 ts_tablet_manager.cc:1397] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Time spent bootstrapping tablet: real 0.031s user 0.020s sys 0.008s
I20260808 05:58:13.160025 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.141147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:34359 (local address 127.2.191.126:33231)
0808 05:58:13.141564 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.141585 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.141897 (+ 312us) server_negotiation.cc:407] Connection header received
0808 05:58:13.143050 (+ 1153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.143066 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.143509 (+ 443us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.143986 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:13.145230 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.146777 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.148071 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.148842 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.149061 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.151742 (+ 2681us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:13.151752 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:13.151770 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:13.151811 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:13.154267 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.154959 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.154968 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.154977 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.155158 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.155579 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.155585 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.155588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.156143 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:13.156299 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.158858 (+ 2559us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.159192 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":262,"thread_start_us":130,"threads_started":1}
I20260808 05:58:13.161531 20364 raft_consensus.cc:348] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:58:13.162066 20364 raft_consensus.cc:729] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff5a060eac4b46af98491d11cca69dfa, State: Initialized, Role: FOLLOWER
I20260808 05:58:13.162681 20364 consensus_queue.cc:260] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } }
I20260808 05:58:13.162731 20482 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33231
I20260808 05:58:13.163081 20482 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:13.163713 20482 heartbeater.cc:511] Master 127.2.191.126:33231 requested a full tablet report, sending...
I20260808 05:58:13.163723 20364 ts_tablet_manager.cc:1428] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 05:58:13.166255 20279 ts_manager.cc:194] Registered new tserver with Master: ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949)
I20260808 05:58:13.169814 20279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:34359
I20260808 05:58:13.172616 20482 heartbeater.cc:503] Master 127.2.191.126:33231 was elected leader, sending a full tablet report...
Aug 08 05:58:13 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168692, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.65@KRBTEST.COM
I20260808 05:58:13.180519 20489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.169204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39949 (local address 127.0.0.1:55528)
0808 05:58:13.169965 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:13.170010 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:13.170167 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:13.170735 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:13.170742 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:13.171150 (+ 408us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:13.171258 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.171265 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.172236 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.172241 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.172992 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.173028 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.173861 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.173867 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.173981 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.174731 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:13.174744 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:13.176449 (+ 1705us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:13.178698 (+ 2249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:13.178708 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:13.178712 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:13.178979 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:13.179316 (+ 337us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:13.179318 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:13.179320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:13.179405 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:13.179940 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:13.179945 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:13.180062 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 05:58:13.180195 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 05:58:13.180371 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":94,"threads_started":1}
I20260808 05:58:13.180662 20490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.169296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55528 (local address 127.2.191.65:39949)
0808 05:58:13.169705 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.169718 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.170120 (+ 402us) server_negotiation.cc:407] Connection header received
0808 05:58:13.170324 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.170330 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.170543 (+ 213us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.170677 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:13.171393 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.172111 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.173169 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.173714 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.173822 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.176632 (+ 2810us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:13.176643 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:13.176656 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:13.176684 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:13.178549 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.179103 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.179110 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.179112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.179213 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.179502 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.179505 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.179507 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.179818 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:13.179950 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.180300 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.180486 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"thread_start_us":122,"threads_started":1}
I20260808 05:58:13.181773 20409 tablet_service.cc:1514] Processing DeleteTablet for tablet d03877100a984be8a787c08d782061d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:57:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:55528
I20260808 05:58:13.182724 20491 tablet_replica.cc:330] stopping tablet replica
I20260808 05:58:13.183039 20491 raft_consensus.cc:2229] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:58:13.183365 20491 raft_consensus.cc:2258] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:13.184516 20491 ts_tablet_manager.cc:1905] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:13.188501 20491 ts_tablet_manager.cc:1918] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:13.188608 20491 log.cc:1196] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal/wals/d03877100a984be8a787c08d782061d1
I20260808 05:58:13.189024 20491 ts_tablet_manager.cc:1939] T d03877100a984be8a787c08d782061d1 P ff5a060eac4b46af98491d11cca69dfa: Deleting consensus metadata
I20260808 05:58:13.191244 20263 catalog_manager.cc:4841] TS ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949): tablet d03877100a984be8a787c08d782061d1 (table test-table [id=09526594ceb346e9891f4d77dd2b28ee]) successfully deleted
W20260808 05:58:13.272477 20487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:13.272799 20487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:13.272909 20487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:13.276945 20487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:13.277040 20487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:13.277144 20487 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:58:13.282467 20487 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:40391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=34499
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20487
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:13.283524 20487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:13.284576 20487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:13.294405 20497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:13.294405 20498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:13.294421 20500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:13.294395 20487 server_base.cc:1034] running on GCE node
I20260808 05:58:13.295058 20487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:13.295775 20487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:13.296967 20487 hybrid_clock.cc:648] HybridClock initialized: now 1786168693296938 us; error 39 us; skew 500 ppm
Aug 08 05:58:13 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168693, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:13.299922 20487 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:58:13.300853 20487 webserver.cc:460] Webserver started at http://127.2.191.66:34499/ using document root <none> and password file <none>
I20260808 05:58:13.301427 20487 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:13.301546 20487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:13.305579 20487 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:58:13.307865 20507 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:13.309437 20487 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:13.309599 20487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "8b40deb1d87444fa82480dc7882f09a6"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "07de454fb45e8053ab191fe0b5c12cdf"
server_key_iv: "2b2e72dfb97ca2a719607f8da167cb3c"
server_key_version: "encryptionkey@0"
I20260808 05:58:13.310256 20487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:13.325006 20487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:13.328972 20487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:13.329212 20487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:13.329883 20487 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:13.330811 20487 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:13.330900 20487 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:13.330988 20487 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:13.331048 20487 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:13.341280 20487 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:40391
I20260808 05:58:13.341302 20629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:40391 every 8 connection(s)
I20260808 05:58:13.342419 20487 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:58:13.348573 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 20487
I20260808 05:58:13.349155 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:38411
--local_ip_for_outbound_sockets=127.2.191.67
--tserver_master_addrs=127.2.191.126:33231
--webserver_port=38621
--webserver_interface=127.2.191.67
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:58:13 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168693, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:13.358461 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.344585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:33857 (local address 127.2.191.126:33231)
0808 05:58:13.344902 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.344915 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.346066 (+ 1151us) server_negotiation.cc:407] Connection header received
0808 05:58:13.347060 (+ 994us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.347063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.347118 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.347204 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:13.348452 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.349362 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.350509 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.350932 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.351063 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.353998 (+ 2935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:13.354005 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:13.354011 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:13.354047 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:13.355911 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.356542 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.356548 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.356553 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.356659 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.357065 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.357069 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.357072 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.357397 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:13.357522 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.358000 (+ 478us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.358206 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260808 05:58:13.359256 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.345158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:33857)
0808 05:58:13.345871 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:13.345917 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:13.346762 (+ 845us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:13.347404 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:13.347411 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:13.347775 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:13.348273 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.348287 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.349494 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.349497 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.350377 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.350387 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.351139 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.351145 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.351364 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.352118 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:13.352143 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:13.353806 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:13.356041 (+ 2235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:13.356046 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:13.356057 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:13.356402 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:13.356797 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:13.356800 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:13.356801 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:13.356933 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:13.357514 (+ 581us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:13.357519 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:13.357749 (+ 230us) client_negotiation.cc:769] Sending connection context
0808 05:58:13.357909 (+ 160us) client_negotiation.cc:240] Negotiation successful
0808 05:58:13.358253 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":133,"threads_started":1}
I20260808 05:58:13.360574 20630 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33231
I20260808 05:58:13.360893 20630 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:13.361603 20630 heartbeater.cc:511] Master 127.2.191.126:33231 requested a full tablet report, sending...
I20260808 05:58:13.362895 20279 ts_manager.cc:194] Registered new tserver with Master: 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391)
I20260808 05:58:13.363471 20279 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:33857
W20260808 05:58:13.470733 20633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:13.471004 20633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:13.471050 20633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:13.475324 20633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:13.475395 20633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:13.475495 20633 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:58:13.481021 20633 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:38411
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=38621
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:13.482105 20633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:13.483078 20633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:13.492955 20639 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:13.493265 20633 server_base.cc:1034] running on GCE node
W20260808 05:58:13.492965 20638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:13.492955 20641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:13.493814 20633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:13.494522 20633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:13.495751 20633 hybrid_clock.cc:648] HybridClock initialized: now 1786168693495716 us; error 46 us; skew 500 ppm
Aug 08 05:58:13 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168693, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:13.499212 20633 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:58:13.500211 20633 webserver.cc:460] Webserver started at http://127.2.191.67:38621/ using document root <none> and password file <none>
I20260808 05:58:13.500895 20633 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:13.501009 20633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:13.505373 20633 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:13.507814 20648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:13.509562 20633 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:13.509722 20633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "9803c7c9f699424ebf1a0abed7d42a93"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "2869789a2c5a7f9df1fc1fca1350fca1"
server_key_iv: "2f6d187a6ded8cf842a2b1ee584b3dd8"
server_key_version: "encryptionkey@0"
I20260808 05:58:13.510340 20633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:13.533301 20633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:13.536590 20633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:13.536852 20633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:13.537571 20633 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:13.538462 20633 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:13.538545 20633 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:13.538621 20633 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:13.538666 20633 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:13.548187 20633 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:38411
I20260808 05:58:13.548215 20768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:38411 every 8 connection(s)
I20260808 05:58:13.549275 20633 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:58:13.558033 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 20633
Aug 08 05:58:13 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168693, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:13.564332 20484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.551091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:57371 (local address 127.2.191.126:33231)
0808 05:58:13.551272 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.551277 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.552401 (+ 1124us) server_negotiation.cc:407] Connection header received
0808 05:58:13.553327 (+ 926us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.553330 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.553383 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.553465 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:13.554686 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.555218 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.556761 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.557046 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.557143 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.560472 (+ 3329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:13.560476 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:13.560479 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:13.560505 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:13.562095 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.562699 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.562704 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.562705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.562798 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.563167 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.563171 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.563172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.563373 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:13.563488 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.564038 (+ 550us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.564160 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 05:58:13.565344 20771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.551524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:57371)
0808 05:58:13.552226 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:13.552270 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:13.553122 (+ 852us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:13.553676 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:13.553682 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:13.554057 (+ 375us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:13.554546 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.554560 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.555369 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.555372 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.556601 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.556613 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.557229 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.557232 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.557398 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.558167 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:13.558191 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:13.560275 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:13.562229 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:13.562236 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:13.562253 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:13.562585 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:13.562896 (+ 311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:13.562900 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:13.562902 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:13.563063 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:13.563488 (+ 425us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:13.563496 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:13.563766 (+ 270us) client_negotiation.cc:769] Sending connection context
0808 05:58:13.563970 (+ 204us) client_negotiation.cc:240] Negotiation successful
0808 05:58:13.564327 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":512,"thread_start_us":116,"threads_started":1}
I20260808 05:58:13.566638 20769 heartbeater.cc:347] Connected to a master server at 127.2.191.126:33231
I20260808 05:58:13.566908 20769 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:13.567126 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.558833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36818 (local address 127.2.191.126:33231)
0808 05:58:13.559134 (+ 301us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.559139 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.559349 (+ 210us) server_negotiation.cc:407] Connection header received
0808 05:58:13.559462 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.559466 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.559526 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.559631 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:13.560426 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.561034 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.561922 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.562156 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.562280 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.563633 (+ 1353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:13.563637 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:13.563639 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:13.563671 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:13.565299 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.565808 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.565813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.565820 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.565898 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.566205 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.566209 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.566211 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.566389 (+ 178us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:13.566623 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.566809 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.566932 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":100,"threads_started":1}
I20260808 05:58:13.567533 20769 heartbeater.cc:511] Master 127.2.191.126:33231 requested a full tablet report, sending...
I20260808 05:58:13.568651 20278 ts_manager.cc:194] Registered new tserver with Master: 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
I20260808 05:58:13.569350 20278 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:57371
I20260808 05:58:13.581269 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:58:13.585709 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.581973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36832 (local address 127.2.191.126:33231)
0808 05:58:13.582118 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.582121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.582352 (+ 231us) server_negotiation.cc:407] Connection header received
0808 05:58:13.582520 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.582523 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.582631 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.582722 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:58:13.582938 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.583546 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.584605 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.584878 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.584961 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.585224 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:58:13.585385 (+ 161us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 05:58:13.585602 (+ 217us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36832: token expired
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 05:58:13.585801 20773 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36832: token expired
W20260808 05:58:13.586154 20199 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.2.191.126:33231)
I20260808 05:58:13.593603 20773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.586548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36842 (local address 127.2.191.126:33231)
0808 05:58:13.586688 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.586695 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.586710 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:58:13.586857 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.586860 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.586907 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.586985 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:13.587649 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.588130 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.589014 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.589225 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.589327 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.590639 (+ 1312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:13.590642 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:13.590645 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:13.590677 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:13.591912 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.592364 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.592368 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.592370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.592453 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:13.592751 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:13.592756 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:13.592758 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:13.592932 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:13.593073 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.593301 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.593420 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:58:13.596462 20278 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:58:13.599839 20278 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:58:13.608196 20409 tablet_service.cc:1467] Processing CreateTablet for tablet 17fa8cc7485d43c1be1923d9304174a7 (DEFAULT_TABLE table=test-table [id=00da7098c9fe43a38a19e960b5032b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:13.608979 20409 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17fa8cc7485d43c1be1923d9304174a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:13.611927 20364 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Bootstrap starting.
I20260808 05:58:13.612916 20364 tablet_bootstrap.cc:654] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:13.612929 20489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.607181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:40391 (local address 127.0.0.1:39164)
0808 05:58:13.607479 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:13.607493 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:13.607606 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:13.608299 (+ 693us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:13.608302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:13.608322 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:13.608435 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.608442 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.610053 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.610056 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.611324 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.611334 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.612381 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.612385 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.612484 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.612544 (+ 60us) client_negotiation.cc:769] Sending connection context
0808 05:58:13.612629 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:58:13.612711 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":30}
I20260808 05:58:13.613010 20778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.607400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39164 (local address 127.2.191.66:40391)
0808 05:58:13.607750 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.607766 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.607791 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:58:13.607875 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.607881 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.608116 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.608601 (+ 485us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:13.608816 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.609910 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.611471 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.612267 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.612382 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.612534 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.612694 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.612820 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":164,"threads_started":1}
I20260808 05:58:13.613809 20779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.607858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:38411 (local address 127.0.0.1:47562)
0808 05:58:13.608199 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:13.608214 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:13.608303 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:13.609089 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:13.609092 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:13.609111 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:13.609208 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.609222 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.610479 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.610483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.611696 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.611707 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.613446 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.613450 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.613540 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.613563 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 05:58:13.613617 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:58:13.613681 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":51,"thread_start_us":124,"threads_started":1}
I20260808 05:58:13.614621 20780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.608027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47562 (local address 127.2.191.67:38411)
0808 05:58:13.608551 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.608561 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.608582 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:58:13.608656 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.608664 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.608906 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.609352 (+ 446us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:13.609496 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.610343 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.611841 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.612865 (+ 1024us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.614143 (+ 1278us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.614321 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.614402 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.614502 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":116,"threads_started":1}
I20260808 05:58:13.616179 20559 tablet_service.cc:1467] Processing CreateTablet for tablet 17fa8cc7485d43c1be1923d9304174a7 (DEFAULT_TABLE table=test-table [id=00da7098c9fe43a38a19e960b5032b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:13.617332 20364 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: No bootstrap required, opened a new log
I20260808 05:58:13.617354 20559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17fa8cc7485d43c1be1923d9304174a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:13.617435 20364 ts_tablet_manager.cc:1397] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 05:58:13.616998 20701 tablet_service.cc:1467] Processing CreateTablet for tablet 17fa8cc7485d43c1be1923d9304174a7 (DEFAULT_TABLE table=test-table [id=00da7098c9fe43a38a19e960b5032b00]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:13.617972 20364 raft_consensus.cc:348] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.618114 20364 raft_consensus.cc:374] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:13.618132 20701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17fa8cc7485d43c1be1923d9304174a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:13.618171 20364 raft_consensus.cc:729] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff5a060eac4b46af98491d11cca69dfa, State: Initialized, Role: FOLLOWER
I20260808 05:58:13.618314 20364 consensus_queue.cc:260] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.619098 20364 ts_tablet_manager.cc:1428] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:58:13.625036 20782 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Bootstrap starting.
I20260808 05:58:13.625037 20783 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Bootstrap starting.
I20260808 05:58:13.627480 20783 tablet_bootstrap.cc:654] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:13.627848 20782 tablet_bootstrap.cc:654] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:13.628585 20782 log.cc:824] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:13.628587 20783 log.cc:824] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:13.630549 20782 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: No bootstrap required, opened a new log
I20260808 05:58:13.630553 20783 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: No bootstrap required, opened a new log
I20260808 05:58:13.630754 20782 ts_tablet_manager.cc:1397] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s
I20260808 05:58:13.630810 20783 ts_tablet_manager.cc:1397] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:58:13.634073 20782 raft_consensus.cc:348] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.634073 20783 raft_consensus.cc:348] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.634338 20782 raft_consensus.cc:374] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:13.634331 20783 raft_consensus.cc:374] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:13.634400 20782 raft_consensus.cc:729] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b40deb1d87444fa82480dc7882f09a6, State: Initialized, Role: FOLLOWER
I20260808 05:58:13.634415 20783 raft_consensus.cc:729] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9803c7c9f699424ebf1a0abed7d42a93, State: Initialized, Role: FOLLOWER
I20260808 05:58:13.634863 20782 consensus_queue.cc:260] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.634886 20783 consensus_queue.cc:260] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.635594 20630 heartbeater.cc:503] Master 127.2.191.126:33231 was elected leader, sending a full tablet report...
I20260808 05:58:13.635842 20769 heartbeater.cc:503] Master 127.2.191.126:33231 was elected leader, sending a full tablet report...
I20260808 05:58:13.635990 20783 ts_tablet_manager.cc:1428] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 05:58:13.636996 20782 ts_tablet_manager.cc:1428] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
W20260808 05:58:13.640333 20483 tablet.cc:2369] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:58:13.800240 20770 tablet.cc:2369] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:58:13.843724 20631 tablet.cc:2369] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:58:13.886688 20787 raft_consensus.cc:482] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:13.886965 20787 raft_consensus.cc:504] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.888315 20787 leader_election.cc:288] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391), ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949)
I20260808 05:58:13.892656 20771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.888670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:40391 (local address 127.2.191.67:37509)
0808 05:58:13.888893 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:13.888914 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:13.889051 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:13.889335 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:13.889339 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:13.889358 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:13.889495 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.889520 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.890376 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.890382 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.891435 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.891445 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.892163 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.892167 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.892292 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.892312 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 05:58:13.892408 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 05:58:13.892491 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":21}
I20260808 05:58:13.892656 20778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.888824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:37509 (local address 127.2.191.66:40391)
0808 05:58:13.888995 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.889067 (+ 72us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.889089 (+ 22us) server_negotiation.cc:407] Connection header received
0808 05:58:13.889156 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.889160 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.889219 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.889325 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:13.889669 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.890248 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.891575 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.892020 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.892163 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.892222 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.892425 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.892503 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:58:13.892995 20788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.889075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39949 (local address 127.2.191.67:34071)
0808 05:58:13.889560 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:13.889573 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:13.889719 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:13.890088 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:13.890091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:13.890108 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:13.890262 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.890269 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.891072 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.891076 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.891864 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:13.891873 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.892578 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.892582 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:13.892673 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.892695 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 05:58:13.892785 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:58:13.892855 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":1,"thread_start_us":147,"threads_started":1}
I20260808 05:58:13.893040 20789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.889210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:34071 (local address 127.2.191.65:39949)
0808 05:58:13.889500 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.889505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.889815 (+ 310us) server_negotiation.cc:407] Connection header received
0808 05:58:13.889888 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.889890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.889947 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.890065 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:13.890390 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.890968 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.892010 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.892447 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.892590 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.892806 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.892845 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.892917 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":100,"threads_started":1}
I20260808 05:58:13.893499 20581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17fa8cc7485d43c1be1923d9304174a7" candidate_uuid: "9803c7c9f699424ebf1a0abed7d42a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b40deb1d87444fa82480dc7882f09a6" is_pre_election: true
I20260808 05:58:13.893648 20433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17fa8cc7485d43c1be1923d9304174a7" candidate_uuid: "9803c7c9f699424ebf1a0abed7d42a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff5a060eac4b46af98491d11cca69dfa" is_pre_election: true
I20260808 05:58:13.893850 20581 raft_consensus.cc:2454] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9803c7c9f699424ebf1a0abed7d42a93 in term 0.
I20260808 05:58:13.893986 20433 raft_consensus.cc:2454] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9803c7c9f699424ebf1a0abed7d42a93 in term 0.
I20260808 05:58:13.894429 20652 leader_election.cc:302] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b40deb1d87444fa82480dc7882f09a6, 9803c7c9f699424ebf1a0abed7d42a93; no voters:
I20260808 05:58:13.894742 20787 raft_consensus.cc:2781] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:58:13.894863 20787 raft_consensus.cc:482] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:58:13.894929 20787 raft_consensus.cc:3037] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:13.896239 20787 raft_consensus.cc:504] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.896610 20787 leader_election.cc:288] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [CANDIDATE]: Term 1 election: Requested vote from peers 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391), ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949)
I20260808 05:58:13.897019 20581 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17fa8cc7485d43c1be1923d9304174a7" candidate_uuid: "9803c7c9f699424ebf1a0abed7d42a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b40deb1d87444fa82480dc7882f09a6"
I20260808 05:58:13.897092 20433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17fa8cc7485d43c1be1923d9304174a7" candidate_uuid: "9803c7c9f699424ebf1a0abed7d42a93" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff5a060eac4b46af98491d11cca69dfa"
I20260808 05:58:13.897181 20581 raft_consensus.cc:3037] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:13.897248 20433 raft_consensus.cc:3037] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:13.898484 20581 raft_consensus.cc:2454] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9803c7c9f699424ebf1a0abed7d42a93 in term 1.
I20260808 05:58:13.898495 20433 raft_consensus.cc:2454] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9803c7c9f699424ebf1a0abed7d42a93 in term 1.
I20260808 05:58:13.898784 20652 leader_election.cc:302] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b40deb1d87444fa82480dc7882f09a6, 9803c7c9f699424ebf1a0abed7d42a93; no voters:
I20260808 05:58:13.898969 20787 raft_consensus.cc:2781] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:13.899219 20787 raft_consensus.cc:686] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 LEADER]: Becoming Leader. State: Replica: 9803c7c9f699424ebf1a0abed7d42a93, State: Running, Role: LEADER
I20260808 05:58:13.899580 20787 consensus_queue.cc:237] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:13.902904 20279 catalog_manager.cc:5495] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67). New cstate: current_term: 1 leader_uuid: "9803c7c9f699424ebf1a0abed7d42a93" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } health_report { overall_health: UNKNOWN } } }
I20260808 05:58:13.982055 20780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:13.978622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47576 (local address 127.2.191.67:38411)
0808 05:58:13.978790 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:13.978794 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:13.978807 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:58:13.978884 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:13.978887 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:13.978944 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:13.979034 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:58:13.979282 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.979787 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.980644 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:13.980913 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:13.980993 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:13.981307 (+ 314us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:58:13.981715 (+ 408us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:58:13.981808 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:13.981864 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 05:58:13.981917 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 05:58:13.988059 20433 raft_consensus.cc:1261] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Refusing update from remote peer 9803c7c9f699424ebf1a0abed7d42a93: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:13.988062 20581 raft_consensus.cc:1261] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 FOLLOWER]: Refusing update from remote peer 9803c7c9f699424ebf1a0abed7d42a93: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:13.988781 20787 consensus_queue.cc:1035] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:13.989008 20790 consensus_queue.cc:1035] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:13.995851 20794 mvcc.cc:205] Tried to move back new op lower bound from 7316146970567344128 to 7316146970215350272. Current Snapshot: MvccSnapshot[applied={T|T < 7316146970567344128}]
I20260808 05:58:13.998582 20795 mvcc.cc:205] Tried to move back new op lower bound from 7316146970567344128 to 7316146970215350272. Current Snapshot: MvccSnapshot[applied={T|T < 7316146970567344128}]
I20260808 05:58:14.004590 20276 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:14.004827 20276 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:14.007625 20276 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Sending DeleteTablet for 3 replicas of tablet 17fa8cc7485d43c1be1923d9304174a7
I20260808 05:58:14.008446 20701 tablet_service.cc:1514] Processing DeleteTablet for tablet 17fa8cc7485d43c1be1923d9304174a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:14 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:47562
I20260808 05:58:14.008466 20559 tablet_service.cc:1514] Processing DeleteTablet for tablet 17fa8cc7485d43c1be1923d9304174a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:14 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:39164
I20260808 05:58:14.008991 20803 tablet_replica.cc:330] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: stopping tablet replica
I20260808 05:58:14.009008 20804 tablet_replica.cc:330] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: stopping tablet replica
I20260808 05:58:14.009156 20409 tablet_service.cc:1514] Processing DeleteTablet for tablet 17fa8cc7485d43c1be1923d9304174a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:14 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:55528
I20260808 05:58:14.009393 20804 raft_consensus.cc:2229] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:58:14.009459 20803 raft_consensus.cc:2229] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:58:14.009778 20804 raft_consensus.cc:2258] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:14.009837 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 20321
I20260808 05:58:14.014545 20803 raft_consensus.cc:2258] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:14.016443 20803 ts_tablet_manager.cc:1905] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:14.018477 20804 ts_tablet_manager.cc:1905] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:14.019450 20803 ts_tablet_manager.cc:1918] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:14.019562 20803 log.cc:1196] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/17fa8cc7485d43c1be1923d9304174a7
I20260808 05:58:14.019901 20803 ts_tablet_manager.cc:1939] T 17fa8cc7485d43c1be1923d9304174a7 P 9803c7c9f699424ebf1a0abed7d42a93: Deleting consensus metadata
W20260808 05:58:14.020843 20263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:39949 (error 108)
I20260808 05:58:14.021347 20260 catalog_manager.cc:4841] TS 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411): tablet 17fa8cc7485d43c1be1923d9304174a7 (table test-table [id=00da7098c9fe43a38a19e960b5032b00]) successfully deleted
I20260808 05:58:14.022140 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 20487
I20260808 05:58:14.022379 20779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:14.022045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:39949 (local address 127.0.0.1:60190)
0808 05:58:14.022230 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:14.022297 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:39949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
W20260808 05:58:14.022531 20263 catalog_manager.cc:4584] TS ff5a060eac4b46af98491d11cca69dfa (127.2.191.65:39949): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 17fa8cc7485d43c1be1923d9304174a7: Network error: Client connection negotiation failed: client connection to 127.2.191.65:39949: connect: Connection refused (error 111)
I20260808 05:58:14.032595 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 20633
I20260808 05:58:14.032956 20779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:14.032537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:40391 (local address 127.0.0.1:39178)
0808 05:58:14.032674 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:14.032848 (+ 174us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.66:40391: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 05:58:14.040566 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 20242
I20260808 05:58:34.049559 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33231
--webserver_interface=127.2.191.126
--webserver_port=40939
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:33231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:34.180773 20807 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:34.181110 20807 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:34.181159 20807 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:34.186050 20807 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:58:34.186142 20807 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:58:34.186160 20807 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:58:34.186177 20807 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:58:34.186199 20807 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:34.186221 20807 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:34.186239 20807 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:58:34.186256 20807 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:58:34.192358 20807 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:33231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:33231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=40939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20807
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:34.193647 20807 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:34.194674 20807 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:34.204221 20813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:34.204380 20807 server_base.cc:1034] running on GCE node
W20260808 05:58:34.204212 20816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:34.204289 20814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:34.205224 20807 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:34.206416 20807 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:34.207624 20807 hybrid_clock.cc:648] HybridClock initialized: now 1786168714207606 us; error 32 us; skew 500 ppm
Aug 08 05:58:34 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168714, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:34.215677 20807 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:58:34.216640 20807 webserver.cc:460] Webserver started at http://127.2.191.126:40939/ using document root <none> and password file <none>
I20260808 05:58:34.217276 20807 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:34.217342 20807 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:34.221585 20807 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:58:34.223904 20823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:34.225581 20807 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260808 05:58:34.225695 20807 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "24d56561caa643c78992913ca50ad101"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "ce6317e1238fc39b53d85665461054f4"
server_key_iv: "0716a5c34216d47cf5e0a4fa5bb45718"
server_key_version: "encryptionkey@0"
I20260808 05:58:34.226272 20807 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:34.247671 20807 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:34.254031 20807 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:34.254297 20807 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:34.266178 20807 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:33231
I20260808 05:58:34.266527 20878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:33231 every 8 connection(s)
I20260808 05:58:34.267643 20807 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:58:34.269184 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 20807
I20260808 05:58:34.269726 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:39949
--local_ip_for_outbound_sockets=127.2.191.65
--tserver_master_addrs=127.2.191.126:33231
--webserver_port=45933
--webserver_interface=127.2.191.65
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:58:34.273545 20879 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:58:34.275408 20879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Bootstrap starting.
I20260808 05:58:34.293856 20879 log.cc:824] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:34.305644 20879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:58:34.306070 20879 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Bootstrap complete.
I20260808 05:58:34.310259 20879 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:58:34.310647 20879 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24d56561caa643c78992913ca50ad101, State: Initialized, Role: FOLLOWER
I20260808 05:58:34.311189 20879 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:58:34.311332 20879 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:58:34.311400 20879 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:58:34.311513 20879 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 2 FOLLOWER]: Advancing to term 3
I20260808 05:58:34.313576 20879 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:58:34.313921 20879 leader_election.cc:302] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24d56561caa643c78992913ca50ad101; no voters:
I20260808 05:58:34.314307 20879 leader_election.cc:288] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 05:58:34.314399 20883 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 05:58:34.314711 20883 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [term 3 LEADER]: Becoming Leader. State: Replica: 24d56561caa643c78992913ca50ad101, State: Running, Role: LEADER
I20260808 05:58:34.315182 20883 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } }
I20260808 05:58:34.315649 20879 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:58:34.316618 20884 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "24d56561caa643c78992913ca50ad101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } } }
I20260808 05:58:34.317009 20884 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:34.316881 20885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24d56561caa643c78992913ca50ad101. Latest consensus state: current_term: 3 leader_uuid: "24d56561caa643c78992913ca50ad101" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24d56561caa643c78992913ca50ad101" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 33231 } } }
I20260808 05:58:34.317524 20885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101 [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:34.317886 20894 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:58:34.323021 20894 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:58:34.323773 20894 catalog_manager.cc:1259] Loaded cluster ID: 0d82d14e65314627b683515b437f46ce
I20260808 05:58:34.323851 20894 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:58:34.326030 20894 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:58:34.326642 20894 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Loaded TSK: 0
I20260808 05:58:34.326730 20894 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 24d56561caa643c78992913ca50ad101: Loaded TSK: 1
F20260808 05:58:34.327337 20894 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fbbf68029ad google::LogMessage::Fail() at ??:0
@ 0x7fbbf680588a google::LogMessage::SendToLog() at ??:0
@ 0x7fbbf68024de google::LogMessage::Flush() at ??:0
@ 0x7fbbf6803a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fbbf94c618d kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fbbf94bef0d kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fbc011677bb kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fbc0114199c kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fbc01142178 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlvE3_clEv at ??:0
@ 0x7fbc01183df8 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fbc011a282b std::function<>::operator()() at ??:0
@ 0x7fbc01141b4f _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_ at ??:0
@ 0x7fbc01142f3e kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fbc0113f579 _ZZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvENKUlvE_clEv at ??:0
@ 0x7fbc01183640 _ZNSt17_Function_handlerIFvvEZN4kudu6master14CatalogManager17ElectedAsLeaderCbEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fbbf8a543d7 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fbbf8a54c83 _ZZN4kudu10ThreadPool12CreateThreadEvENKUlvE_clEv at ??:0
@ 0x7fbbf8a563f2 _ZNSt17_Function_handlerIFvvEZN4kudu10ThreadPool12CreateThreadEvEUlvE_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x61d838 std::function<>::operator()() at ??:0
@ 0x7fbbf8a45512 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fbbfa0896db start_thread at ??:0
@ 0x7fbbf530061f clone at ??:0
W20260808 05:58:34.409897 20881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:34.410140 20881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:34.410185 20881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:34.414690 20881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:34.414741 20881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:34.414804 20881 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:58:34.420562 20881 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:39949
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=45933
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20881
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:34.421922 20881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:34.422995 20881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:34.433213 20926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:34.433476 20881 server_base.cc:1034] running on GCE node
W20260808 05:58:34.433697 20925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:34.433799 20928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:34.434196 20881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:34.434764 20881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:34.438052 20881 hybrid_clock.cc:648] HybridClock initialized: now 1786168714437988 us; error 63 us; skew 500 ppm
Aug 08 05:58:34 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168714, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:34.440914 20881 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:58:34.442049 20881 webserver.cc:460] Webserver started at http://127.2.191.65:45933/ using document root <none> and password file <none>
I20260808 05:58:34.442605 20881 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:34.442656 20881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:34.447150 20881 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:34.449620 20939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:34.451056 20881 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:58:34.451200 20881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "ff5a060eac4b46af98491d11cca69dfa"
format_stamp: "Formatted at 2026-08-08 05:57:51 on dist-test-slave-qg60"
server_key: "d38a69c99a3d604dc2848cb76e7a34bc"
server_key_iv: "2234de6db04db2f5b302d996b08171b2"
server_key_version: "encryptionkey@0"
I20260808 05:58:34.451813 20881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:34.469340 20881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:34.472674 20881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:34.472911 20881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:34.473542 20881 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:34.474707 20947 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:58:34.480813 20881 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:58:34.480911 20881 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.000s sys 0.000s
I20260808 05:58:34.480990 20881 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:58:34.482873 20881 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:58:34.482950 20881 ts_tablet_manager.cc:589] Time spent register tablets: real 0.002s user 0.000s sys 0.000s
I20260808 05:58:34.483281 20947 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Bootstrap starting.
I20260808 05:58:34.495203 20881 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:39949
I20260808 05:58:34.495517 21060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:39949 every 8 connection(s)
I20260808 05:58:34.496377 20881 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:58:34.497920 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 20881
I20260808 05:58:34.498528 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:40391
--local_ip_for_outbound_sockets=127.2.191.66
--tserver_master_addrs=127.2.191.126:33231
--webserver_port=34499
--webserver_interface=127.2.191.66
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:58:34.508180 20947 log.cc:824] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:34.518551 20947 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:58:34.519176 20947 tablet_bootstrap.cc:492] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Bootstrap complete.
I20260808 05:58:34.520888 20947 ts_tablet_manager.cc:1397] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Time spent bootstrapping tablet: real 0.038s user 0.025s sys 0.012s
I20260808 05:58:34.524679 20947 raft_consensus.cc:348] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:34.525329 20947 raft_consensus.cc:729] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff5a060eac4b46af98491d11cca69dfa, State: Initialized, Role: FOLLOWER
I20260808 05:58:34.525902 20947 consensus_queue.cc:260] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:34.527057 20947 ts_tablet_manager.cc:1428] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa: Time spent starting tablet: real 0.006s user 0.005s sys 0.001s
W20260808 05:58:34.607093 21064 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:58:34.498983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:59883)
0808 05:58:34.500606 (+ 1623us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.500683 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:34.502119 (+ 1436us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:34.606204 (+104085us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":1337,"thread_start_us":156,"threads_started":1}
W20260808 05:58:34.607703 21061 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:33231 (0 consecutive failures): Network error: Failed to ping master at 127.2.191.126:33231: Client connection negotiation failed: client connection to 127.2.191.126:33231: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:58:34.608562 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:34.608301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:44627)
0808 05:58:34.608433 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.608505 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 05:58:34.609393 21064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:34.609167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:38163)
0808 05:58:34.609301 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.609346 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 05:58:34.609579 21061 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:58:34.624500 21065 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:34.624859 21065 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:34.624974 21065 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:34.629225 21065 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:34.629295 21065 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:34.629379 21065 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:58:34.634728 21065 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:40391
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=34499
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21065
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:34.635774 21065 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:34.636816 21065 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:34.646696 21075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:34.646697 21073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:34.646886 21065 server_base.cc:1034] running on GCE node
W20260808 05:58:34.646780 21072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:34.647465 21065 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:34.648130 21065 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:34.649283 21065 hybrid_clock.cc:648] HybridClock initialized: now 1786168714649268 us; error 27 us; skew 500 ppm
Aug 08 05:58:34 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168714, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:34.652004 21065 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:58:34.652941 21065 webserver.cc:460] Webserver started at http://127.2.191.66:34499/ using document root <none> and password file <none>
I20260808 05:58:34.653472 21065 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:34.653529 21065 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:34.657559 21065 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.000s sys 0.003s
I20260808 05:58:34.659685 21082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:34.661164 21065 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:34.661284 21065 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "8b40deb1d87444fa82480dc7882f09a6"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "07de454fb45e8053ab191fe0b5c12cdf"
server_key_iv: "2b2e72dfb97ca2a719607f8da167cb3c"
server_key_version: "encryptionkey@0"
I20260808 05:58:34.661862 21065 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:34.681418 21065 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:34.685052 21065 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:34.685217 21065 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:34.685781 21065 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:34.686930 21090 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
W20260808 05:58:34.690852 21090 ts_tablet_manager.cc:1852] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260808 05:58:34.691249 21090 ts_tablet_manager.cc:1905] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:34.695425 21090 ts_tablet_manager.cc:1918] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:34.695531 21090 log.cc:1196] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/17fa8cc7485d43c1be1923d9304174a7
I20260808 05:58:34.695971 21090 ts_tablet_manager.cc:1939] T 17fa8cc7485d43c1be1923d9304174a7 P 8b40deb1d87444fa82480dc7882f09a6: Deleting consensus metadata
I20260808 05:58:34.696303 21065 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260808 05:58:34.696388 21065 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.010s user 0.001s sys 0.000s
I20260808 05:58:34.696475 21065 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:34.696523 21065 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:34.705812 21065 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:40391
I20260808 05:58:34.705899 21201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:40391 every 8 connection(s)
I20260808 05:58:34.706744 21065 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:58:34.710305 21204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:34.708987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:49133)
0808 05:58:34.709459 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.709569 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":266,"thread_start_us":115,"threads_started":1}
W20260808 05:58:34.710729 21202 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:33231 (0 consecutive failures): Network error: Failed to ping master at 127.2.191.126:33231: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
I20260808 05:58:34.711040 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 21065
I20260808 05:58:34.711438 21204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:34.711181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:51107)
0808 05:58:34.711298 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.711366 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 05:58:34.711586 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:38411
--local_ip_for_outbound_sockets=127.2.191.67
--tserver_master_addrs=127.2.191.126:33231
--webserver_port=38621
--webserver_interface=127.2.191.67
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:43291
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:58:34.712080 21204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:34.711883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:41131)
0808 05:58:34.711982 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.712029 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 05:58:34.712296 21202 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:58:34.830220 21205 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:34.830470 21205 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:34.830541 21205 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:34.834669 21205 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:34.834738 21205 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:34.834833 21205 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:58:34.840315 21205 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:43291
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:38411
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=38621
--tserver_master_addrs=127.2.191.126:33231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21205
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:34.841491 21205 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:34.842624 21205 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:34.852720 21212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:34.852780 21210 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:34.852908 21215 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:34.852962 21205 server_base.cc:1034] running on GCE node
I20260808 05:58:34.853561 21205 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:34.854233 21205 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:34.855415 21205 hybrid_clock.cc:648] HybridClock initialized: now 1786168714855397 us; error 30 us; skew 500 ppm
Aug 08 05:58:34 dist-test-slave-qg60 krb5kdc[19652](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168714, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:34.858237 21205 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:58:34.859164 21205 webserver.cc:460] Webserver started at http://127.2.191.67:38621/ using document root <none> and password file <none>
I20260808 05:58:34.859696 21205 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:34.859754 21205 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:34.863528 21205 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 05:58:34.865644 21222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:34.867038 21205 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260808 05:58:34.867172 21205 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "9803c7c9f699424ebf1a0abed7d42a93"
format_stamp: "Formatted at 2026-08-08 05:57:52 on dist-test-slave-qg60"
server_key: "2869789a2c5a7f9df1fc1fca1350fca1"
server_key_iv: "2f6d187a6ded8cf842a2b1ee584b3dd8"
server_key_version: "encryptionkey@0"
I20260808 05:58:34.867707 21205 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:34.886854 21205 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:34.890015 21205 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:34.890226 21205 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:34.890862 21205 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:34.891750 21205 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:34.891819 21205 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:34.891891 21205 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:34.891929 21205 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:34.901525 21205 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:38411
I20260808 05:58:34.901561 21344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:38411 every 8 connection(s)
I20260808 05:58:34.902535 21205 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:58:34.906220 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:34.904645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:59401)
0808 05:58:34.905409 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.905519 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":566,"thread_start_us":131,"threads_started":1}
W20260808 05:58:34.906667 21345 heartbeater.cc:644] Failed to heartbeat to 127.2.191.126:33231 (0 consecutive failures): Network error: Failed to ping master at 127.2.191.126:33231: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
I20260808 05:58:34.907227 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:34.907026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:52501)
0808 05:58:34.907126 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.907174 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 05:58:34.907919 21347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:34.907697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:54991)
0808 05:58:34.907830 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:34.907874 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260808 05:58:34.908146 21345 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:58:34.909389 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 21205
I20260808 05:58:35.610741 21349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:35.610270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:33383)
0808 05:58:35.610552 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:35.610618 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":79,"threads_started":1}
I20260808 05:58:35.713291 21350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:35.712909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:36871)
0808 05:58:35.713154 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:35.713206 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":71,"threads_started":1}
I20260808 05:58:35.909222 21351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:35.908721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:41265)
0808 05:58:35.908993 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:35.909092 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":68,"threads_started":1}
I20260808 05:58:36.277944 21352 raft_consensus.cc:482] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:36.278198 21352 raft_consensus.cc:504] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:36.279388 21352 leader_election.cc:288] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391), 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
Aug 08 05:58:36 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168714, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.66@KRBTEST.COM
Aug 08 05:58:36 dist-test-slave-qg60 krb5kdc[19652](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168714, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.67@KRBTEST.COM
I20260808 05:58:36.294117 21353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:36.279653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:40391 (local address 127.2.191.65:44697)
0808 05:58:36.280061 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:36.280080 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:36.280201 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:36.282053 (+ 1852us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:36.282060 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:36.282610 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:36.283069 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:36.283085 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:36.284406 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:36.284409 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:36.285369 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:36.285380 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:36.286139 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:36.286143 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:36.286323 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:36.287003 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:36.287029 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:36.288826 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:36.291402 (+ 2576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:36.291407 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:36.291419 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:36.291676 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:36.292117 (+ 441us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:36.292120 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:36.292122 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:36.292270 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:36.293232 (+ 962us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:36.293235 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:36.293486 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 05:58:36.293675 (+ 189us) client_negotiation.cc:240] Negotiation successful
0808 05:58:36.293933 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":44,"spinlock_wait_cycles":19840,"thread_start_us":81,"threads_started":1}
I20260808 05:58:36.294247 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:36.279653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:38411 (local address 127.2.191.65:49691)
0808 05:58:36.280136 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:36.280148 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:36.280219 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:36.282481 (+ 2262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:36.282484 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:36.282720 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:36.283070 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:36.283086 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:36.284508 (+ 1422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:36.284514 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:36.285370 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:36.285380 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:36.286365 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:36.286369 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:36.286457 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:36.287146 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:36.287158 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:36.289143 (+ 1985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:36.291773 (+ 2630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:36.291774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:36.291776 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:36.291928 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:36.292302 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:36.292307 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:36.292309 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:36.292404 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:36.293223 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:36.293229 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:36.293480 (+ 251us) client_negotiation.cc:769] Sending connection context
0808 05:58:36.293678 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 05:58:36.294034 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":407,"mutex_wait_us":141,"spinlock_wait_cycles":8704,"thread_start_us":64,"threads_started":1}
I20260808 05:58:36.294271 21355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:36.279846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:44697 (local address 127.2.191.66:40391)
0808 05:58:36.280470 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:36.280483 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:36.280518 (+ 35us) server_negotiation.cc:407] Connection header received
0808 05:58:36.281260 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:36.281267 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:36.281655 (+ 388us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:36.281984 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:36.283256 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:36.284253 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:36.285513 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:36.286008 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:36.286197 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:36.289089 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:36.289095 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:36.289107 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:36.289135 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:36.291277 (+ 2142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:36.291781 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:36.291786 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:36.291790 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:36.291908 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:36.292370 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:36.292375 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:36.292376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:36.293038 (+ 662us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:36.293170 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:36.293806 (+ 636us) server_negotiation.cc:299] Negotiation successful
0808 05:58:36.294094 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":519,"thread_start_us":125,"threads_started":1}
I20260808 05:58:36.295077 21356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:36.279846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:49691 (local address 127.2.191.67:38411)
0808 05:58:36.280332 (+ 486us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:36.280356 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:36.280399 (+ 43us) server_negotiation.cc:407] Connection header received
0808 05:58:36.281218 (+ 819us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:36.281226 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:36.281604 (+ 378us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:36.281992 (+ 388us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:36.283270 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:36.284358 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:36.285522 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:36.286108 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:36.286432 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:36.289348 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:36.289357 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:36.289374 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:36.289411 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:36.291277 (+ 1866us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:36.292054 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:36.292062 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:36.292070 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:36.292199 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:36.292512 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:36.292515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:36.292517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:36.293011 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:36.293161 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:36.294617 (+ 1456us) server_negotiation.cc:299] Negotiation successful
0808 05:58:36.294896 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":371,"thread_start_us":133,"threads_started":1}
W20260808 05:58:36.297128 20940 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
W20260808 05:58:36.297325 20944 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
I20260808 05:58:36.297425 20944 leader_election.cc:302] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff5a060eac4b46af98491d11cca69dfa; no voters: 8b40deb1d87444fa82480dc7882f09a6, 9803c7c9f699424ebf1a0abed7d42a93
I20260808 05:58:36.297698 21352 raft_consensus.cc:2726] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:58:36.611857 21354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:36.611586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:39971)
0808 05:58:36.611715 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:36.611771 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 05:58:36.714438 21357 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:36.714028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:44267)
0808 05:58:36.714273 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:36.714332 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":75,"threads_started":1}
I20260808 05:58:36.910612 21358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:36.910189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:37223)
0808 05:58:36.910450 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:36.910509 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":76,"threads_started":1}
I20260808 05:58:37.613245 21359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:37.612696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:47303)
0808 05:58:37.613034 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:37.613142 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":255,"thread_start_us":93,"threads_started":1}
I20260808 05:58:37.715718 21360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:37.715229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:39375)
0808 05:58:37.715523 (+ 294us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:37.715590 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":78,"threads_started":1}
I20260808 05:58:37.912014 21361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:37.911542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:43413)
0808 05:58:37.911816 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:37.911876 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":195,"thread_start_us":84,"threads_started":1}
I20260808 05:58:38.317834 21362 raft_consensus.cc:482] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:38.317979 21362 raft_consensus.cc:504] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:38.318423 21362 leader_election.cc:288] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391), 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
W20260808 05:58:38.319365 20944 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
W20260808 05:58:38.319528 20940 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
I20260808 05:58:38.319643 20940 leader_election.cc:302] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff5a060eac4b46af98491d11cca69dfa; no voters: 8b40deb1d87444fa82480dc7882f09a6, 9803c7c9f699424ebf1a0abed7d42a93
I20260808 05:58:38.319829 21362 raft_consensus.cc:2726] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:58:38.614650 21363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:38.614143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:54877)
0808 05:58:38.614447 (+ 304us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:38.614515 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":86,"threads_started":1}
I20260808 05:58:38.717267 21364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:38.716589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:32773)
0808 05:58:38.716952 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:38.717033 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":271,"thread_start_us":85,"threads_started":1}
I20260808 05:58:38.913419 21365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:38.912981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:56749)
0808 05:58:38.913251 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:38.913319 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":78,"threads_started":1}
I20260808 05:58:39.616153 21366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:39.615681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:44199)
0808 05:58:39.615987 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:39.616046 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":80,"threads_started":1}
I20260808 05:58:39.718567 21367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:39.718122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:60441)
0808 05:58:39.718406 (+ 284us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:39.718467 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":78,"threads_started":1}
I20260808 05:58:39.914733 21368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:39.914281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:55677)
0808 05:58:39.914557 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:39.914619 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":82,"threads_started":1}
I20260808 05:58:40.617532 21369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:40.617069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:45647)
0808 05:58:40.617358 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:40.617428 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":82,"threads_started":1}
I20260808 05:58:40.719969 21370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:40.719444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:32911)
0808 05:58:40.719791 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:40.719859 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":114,"threads_started":1}
I20260808 05:58:40.889212 21371 raft_consensus.cc:482] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:40.889379 21371 raft_consensus.cc:504] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:40.889904 21371 leader_election.cc:288] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391), 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
W20260808 05:58:40.890697 20944 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
W20260808 05:58:40.890805 20940 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
I20260808 05:58:40.890897 20940 leader_election.cc:302] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff5a060eac4b46af98491d11cca69dfa; no voters: 8b40deb1d87444fa82480dc7882f09a6, 9803c7c9f699424ebf1a0abed7d42a93
I20260808 05:58:40.891033 21371 raft_consensus.cc:2726] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:58:40.916101 21372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:40.915655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:52989)
0808 05:58:40.915931 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:40.915991 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":98,"threads_started":1}
I20260808 05:58:41.618732 21373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:41.618312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:44915)
0808 05:58:41.618578 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:41.618635 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":81,"threads_started":1}
I20260808 05:58:41.721315 21374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:41.720853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:53313)
0808 05:58:41.721158 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:41.721219 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":73,"threads_started":1}
I20260808 05:58:41.917470 21375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:41.916939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:45341)
0808 05:58:41.917304 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:41.917373 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":288,"thread_start_us":92,"threads_started":1}
I20260808 05:58:42.620069 21376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:42.619626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:53481)
0808 05:58:42.619902 (+ 276us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:42.619965 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":83,"threads_started":1}
I20260808 05:58:42.722640 21377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:42.722154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:55163)
0808 05:58:42.722476 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:42.722540 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":78,"threads_started":1}
I20260808 05:58:42.918809 21378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:42.918306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:59445)
0808 05:58:42.918648 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:42.918710 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":256,"thread_start_us":101,"threads_started":1}
I20260808 05:58:43.614449 21379 raft_consensus.cc:482] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:43.614609 21379 raft_consensus.cc:504] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:43.615219 21379 leader_election.cc:288] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391), 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
W20260808 05:58:43.616072 20940 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
W20260808 05:58:43.616186 20944 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
I20260808 05:58:43.616324 20944 leader_election.cc:302] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff5a060eac4b46af98491d11cca69dfa; no voters: 8b40deb1d87444fa82480dc7882f09a6, 9803c7c9f699424ebf1a0abed7d42a93
I20260808 05:58:43.616508 21379 raft_consensus.cc:2726] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:58:43.621378 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:43.620878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:53095)
0808 05:58:43.621199 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:43.621261 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":243,"thread_start_us":88,"threads_started":1}
I20260808 05:58:43.723840 21381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:43.723421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:38343)
0808 05:58:43.723680 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:43.723740 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":79,"threads_started":1}
I20260808 05:58:43.920212 21382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:43.919744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:32825)
0808 05:58:43.920061 (+ 317us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:43.920114 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":107,"threads_started":1}
I20260808 05:58:44.622815 21383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:44.622324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:40829)
0808 05:58:44.622654 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:44.622716 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":103,"threads_started":1}
I20260808 05:58:44.725394 21384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:44.724913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:36673)
0808 05:58:44.725218 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:44.725289 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":218,"thread_start_us":78,"threads_started":1}
I20260808 05:58:44.921627 21385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:44.921148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:37743)
0808 05:58:44.921455 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:44.921523 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":100,"threads_started":1}
I20260808 05:58:45.624185 21386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:45.623771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:49111)
0808 05:58:45.624028 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:45.624087 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":83,"threads_started":1}
I20260808 05:58:45.726794 21387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:45.726325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:52701)
0808 05:58:45.726630 (+ 305us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:45.726695 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":226,"thread_start_us":99,"threads_started":1}
I20260808 05:58:45.922930 21388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:45.922493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:43375)
0808 05:58:45.922761 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:45.922824 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":82,"threads_started":1}
I20260808 05:58:46.625653 21389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:46.625089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:40341)
0808 05:58:46.625438 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:46.625519 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":80,"threads_started":1}
I20260808 05:58:46.728103 21390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:46.727697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:50833)
0808 05:58:46.727941 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:46.727998 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":77,"threads_started":1}
I20260808 05:58:46.924248 21391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:46.923744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:55219)
0808 05:58:46.924033 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:46.924130 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":83,"threads_started":1}
I20260808 05:58:47.627070 21392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:47.626617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:50115)
0808 05:58:47.626898 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:47.626964 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":81,"threads_started":1}
I20260808 05:58:47.729681 21393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:47.729079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:38743)
0808 05:58:47.729456 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:47.729534 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":258,"thread_start_us":98,"threads_started":1}
I20260808 05:58:47.925742 21394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:47.925252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:46775)
0808 05:58:47.925564 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:47.925633 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":80,"threads_started":1}
I20260808 05:58:48.628525 21395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:48.628052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:33431)
0808 05:58:48.628334 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:48.628398 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":85,"threads_started":1}
I20260808 05:58:48.730935 21396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:48.730467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:57827)
0808 05:58:48.730767 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:48.730834 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":84,"threads_started":1}
I20260808 05:58:48.766865 21397 raft_consensus.cc:482] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:48.767109 21397 raft_consensus.cc:504] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8b40deb1d87444fa82480dc7882f09a6" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 40391 } } peers { permanent_uuid: "9803c7c9f699424ebf1a0abed7d42a93" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 38411 } } peers { permanent_uuid: "ff5a060eac4b46af98491d11cca69dfa" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 39949 } }
I20260808 05:58:48.767635 21397 leader_election.cc:288] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391), 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411)
W20260808 05:58:48.768498 20944 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 8b40deb1d87444fa82480dc7882f09a6 (127.2.191.66:40391): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
W20260808 05:58:48.768603 20940 leader_election.cc:341] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9803c7c9f699424ebf1a0abed7d42a93 (127.2.191.67:38411): Not found: Tablet not found: 17fa8cc7485d43c1be1923d9304174a7
I20260808 05:58:48.768700 20940 leader_election.cc:302] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff5a060eac4b46af98491d11cca69dfa; no voters: 8b40deb1d87444fa82480dc7882f09a6, 9803c7c9f699424ebf1a0abed7d42a93
I20260808 05:58:48.768889 21397 raft_consensus.cc:2726] T 17fa8cc7485d43c1be1923d9304174a7 P ff5a060eac4b46af98491d11cca69dfa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:58:48.927232 21398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:48.926651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:49019)
0808 05:58:48.927037 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:48.927122 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":236,"thread_start_us":107,"threads_started":1}
I20260808 05:58:49.630270 21399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:49.629778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.65:49075)
0808 05:58:49.630103 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:49.630169 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":246,"thread_start_us":107,"threads_started":1}
I20260808 05:58:49.732631 21400 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:49.732094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.66:56365)
0808 05:58:49.732393 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:49.732455 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":76,"threads_started":1}
I20260808 05:58:49.919358 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 20881
I20260808 05:58:49.928915 21401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:49.928329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:33231 (local address 127.2.191.67:58943)
0808 05:58:49.928723 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:49.928810 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.126:33231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":311,"thread_start_us":104,"threads_started":1}
I20260808 05:58:49.929049 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 21065
I20260808 05:58:49.936573 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 21205
2026-08-08T05:58:49Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59725 ms)
[----------] 30 tests from SecurityITest (251910 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:58:50 dist-test-slave-qg60 krb5kdc[21404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:58:50 dist-test-slave-qg60 krb5kdc[21404](info): set up 2 sockets
Aug 08 05:58:50 dist-test-slave-qg60 krb5kdc[21404](info): commencing operation
krb5kdc: starting...
W20260808 05:58:51.070609 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:58:51 dist-test-slave-qg60 krb5kdc[21404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:58:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:58:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:58:51.211841 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:45129
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:45129
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:51.326362 21418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:51.326659 21418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:51.326700 21418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:51.330636 21418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:58:51.330686 21418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:51.330706 21418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:51.330722 21418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:58:51.330737 21418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:58:51.335963 21418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:45129
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:45129
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:51.337088 21418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:51.338100 21418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:51.347365 21423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:51.347438 21418 server_base.cc:1034] running on GCE node
W20260808 05:58:51.347383 21427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:51.347371 21425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:51.348206 21418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:51.349414 21418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:51.350587 21418 hybrid_clock.cc:648] HybridClock initialized: now 1786168731350552 us; error 46 us; skew 500 ppm
Aug 08 05:58:51 dist-test-slave-qg60 krb5kdc[21404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168731, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:51.358592 21418 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:58:51.359624 21418 webserver.cc:460] Webserver started at http://127.2.191.126:42967/ using document root <none> and password file <none>
I20260808 05:58:51.360251 21418 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:51.360350 21418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:51.360596 21418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:51.362782 21418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "1f18ca711a7a495fac67605712a9a0bf"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "5865490b34692708583d68d419ecd2c9"
server_key_iv: "6b70939da58e8094c04c3bbac85907e8"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.363356 21418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "1f18ca711a7a495fac67605712a9a0bf"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "5865490b34692708583d68d419ecd2c9"
server_key_iv: "6b70939da58e8094c04c3bbac85907e8"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.367221 21418 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 05:58:51.369671 21434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:51.370931 21418 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:58:51.371104 21418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "1f18ca711a7a495fac67605712a9a0bf"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "5865490b34692708583d68d419ecd2c9"
server_key_iv: "6b70939da58e8094c04c3bbac85907e8"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.371224 21418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:51.387042 21418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:51.390718 21418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:51.390935 21418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:51.398500 21418 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:45129
I20260808 05:58:51.398530 21491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:45129 every 8 connection(s)
I20260808 05:58:51.399490 21418 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:58:51.402307 21492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:51.408056 21492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf: Bootstrap starting.
I20260808 05:58:51.409394 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 21418
I20260808 05:58:51.409575 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:58:51.409897 2813 external_mini_cluster.cc:1428] Setting key 724f63211e430d22721742fe33c6f8e3
I20260808 05:58:51.411080 21492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:51.411860 21492 log.cc:824] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:51.414361 21492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf: No bootstrap required, opened a new log
I20260808 05:58:51.418879 21492 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f18ca711a7a495fac67605712a9a0bf" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 45129 } }
I20260808 05:58:51.419209 21492 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:51.419298 21492 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f18ca711a7a495fac67605712a9a0bf, State: Initialized, Role: FOLLOWER
Aug 08 05:58:51 dist-test-slave-qg60 krb5kdc[21404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:51.419838 21492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f18ca711a7a495fac67605712a9a0bf" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 45129 } }
I20260808 05:58:51.420020 21492 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:58:51.420099 21492 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:58:51.420215 21492 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:51.421399 21492 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f18ca711a7a495fac67605712a9a0bf" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 45129 } }
I20260808 05:58:51.421787 21492 leader_election.cc:302] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f18ca711a7a495fac67605712a9a0bf; no voters:
I20260808 05:58:51.422185 21492 leader_election.cc:288] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:58:51.422333 21497 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:51.422637 21497 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [term 1 LEADER]: Becoming Leader. State: Replica: 1f18ca711a7a495fac67605712a9a0bf, State: Running, Role: LEADER
I20260808 05:58:51.423024 21497 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f18ca711a7a495fac67605712a9a0bf" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 45129 } }
I20260808 05:58:51.423645 21492 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:58:51.424337 21499 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1f18ca711a7a495fac67605712a9a0bf. Latest consensus state: current_term: 1 leader_uuid: "1f18ca711a7a495fac67605712a9a0bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f18ca711a7a495fac67605712a9a0bf" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 45129 } } }
I20260808 05:58:51.424456 21499 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:51.425320 21498 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1f18ca711a7a495fac67605712a9a0bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f18ca711a7a495fac67605712a9a0bf" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 45129 } } }
I20260808 05:58:51.425514 21498 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:51.427307 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:51.411241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47000 (local address 127.2.191.126:45129)
0808 05:58:51.411742 (+ 501us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:51.411758 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:51.411795 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:58:51.412767 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:51.412794 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:51.413137 (+ 343us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:51.413418 (+ 281us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:51.414416 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.415565 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.416819 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.417328 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.417456 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:51.420610 (+ 3154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:51.420615 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:51.420629 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:51.420658 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:51.423235 (+ 2577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:51.423755 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:51.423761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:51.423767 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:51.423910 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:51.424257 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:51.424261 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:51.424262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:51.424859 (+ 597us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:51.425069 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:51.426031 (+ 962us) server_negotiation.cc:299] Negotiation successful
0808 05:58:51.426387 (+ 356us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":336,"thread_start_us":178,"threads_started":1}
W20260808 05:58:51.429171 21513 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:58:51.429261 21513 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:58:51.429347 21503 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:58:51.430176 21503 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:58:51.435626 21503 catalog_manager.cc:1347] Generated new cluster ID: ac145e85c8b8453582e2c8c2eddd1cd6
I20260808 05:58:51.435722 21503 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:58:51.453521 21503 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:58:51.454550 21503 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:58:51.459884 21503 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf: Generated new TSK 0
I20260808 05:58:51.460798 21503 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:58:51.492944 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:45129
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:51.615016 21518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:51.615327 21518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:51.615377 21518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:51.620066 21518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:51.620148 21518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:51.620255 21518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:58:51.626850 21518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:45129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:51.628170 21518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:51.629431 21518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:58:51.640244 21518 server_base.cc:1034] running on GCE node
W20260808 05:58:51.640208 21524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:51.640220 21523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:51.640208 21526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:51.640969 21518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:51.641666 21518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:51.642881 21518 hybrid_clock.cc:648] HybridClock initialized: now 1786168731642843 us; error 47 us; skew 500 ppm
Aug 08 05:58:51 dist-test-slave-qg60 krb5kdc[21404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168731, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:51.645843 21518 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:58:51.646826 21518 webserver.cc:460] Webserver started at http://127.2.191.65:37911/ using document root <none> and password file <none>
I20260808 05:58:51.647413 21518 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:51.647478 21518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:51.647747 21518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:51.649960 21518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "d0be322c6774d164fdc1ae8d257c6c77"
server_key_iv: "487451e7a2f817c17a7648877ad6710d"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.650571 21518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "d0be322c6774d164fdc1ae8d257c6c77"
server_key_iv: "487451e7a2f817c17a7648877ad6710d"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.654493 21518 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:58:51.657090 21533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:51.658342 21518 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:58:51.658469 21518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "d0be322c6774d164fdc1ae8d257c6c77"
server_key_iv: "487451e7a2f817c17a7648877ad6710d"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.658612 21518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:51.668982 21518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:51.671902 21518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:51.672120 21518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:51.672822 21518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:51.673712 21518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:51.673795 21518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:51.673894 21518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:51.673946 21518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:51.683193 21518 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:42423
I20260808 05:58:51.683225 21654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:42423 every 8 connection(s)
I20260808 05:58:51.684103 21518 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:58:51.690888 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 21518
I20260808 05:58:51.691057 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:58:51.691341 2813 external_mini_cluster.cc:1428] Setting key fa9418064d5efb4ed7eb84a70f56465d
Aug 08 05:58:51 dist-test-slave-qg60 krb5kdc[21404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168731, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:51.698410 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:51.685974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:56405 (local address 127.2.191.126:45129)
0808 05:58:51.686158 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:51.686161 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:51.686963 (+ 802us) server_negotiation.cc:407] Connection header received
0808 05:58:51.687855 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:51.687858 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:51.687908 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:51.687985 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:51.689271 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.689803 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.690976 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.691319 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.691431 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:51.694213 (+ 2782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:51.694220 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:51.694227 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:51.694263 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:51.695896 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:51.696583 (+ 687us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:51.696587 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:51.696588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:51.696682 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:51.697215 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:51.697220 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:51.697222 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:51.697427 (+ 205us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:51.697552 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:51.698065 (+ 513us) server_negotiation.cc:299] Negotiation successful
0808 05:58:51.698226 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260808 05:58:51.699235 21657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:51.686346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:45129 (local address 127.2.191.65:56405)
0808 05:58:51.686799 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:51.686842 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:51.687651 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:51.688183 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:51.688189 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:51.688539 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:51.689129 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:51.689144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.689910 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.689913 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:51.690841 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:51.690851 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.691489 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.691493 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:51.691659 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:51.692317 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:51.692337 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:51.694029 (+ 1692us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:51.696027 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:51.696042 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:51.696063 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:51.696459 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:51.696888 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:51.696890 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:51.696892 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:51.697103 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:51.697544 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:51.697551 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:51.697816 (+ 265us) client_negotiation.cc:769] Sending connection context
0808 05:58:51.698017 (+ 201us) client_negotiation.cc:240] Negotiation successful
0808 05:58:51.698368 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":120,"threads_started":1}
I20260808 05:58:51.700567 21655 heartbeater.cc:347] Connected to a master server at 127.2.191.126:45129
I20260808 05:58:51.700850 21655 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:51.701354 21655 heartbeater.cc:511] Master 127.2.191.126:45129 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:58:51.703089 21452 ts_manager.cc:194] Registered new tserver with Master: 77e6f8ae518c4da5a8cd4a7b252fbc2f (127.2.191.65:42423)
I20260808 05:58:51.704249 21452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:56405
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:58:51.723903 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:45129
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:51.838497 21660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:51.838747 21660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:51.838791 21660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:51.842931 21660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:51.842993 21660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:51.843103 21660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:58:51.848528 21660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:45129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:51.849666 21660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:51.850795 21660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:51.860862 21667 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:51.860857 21666 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:51.860854 21660 server_base.cc:1034] running on GCE node
W20260808 05:58:51.860854 21669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:51.861557 21660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:51.862257 21660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:51.863471 21660 hybrid_clock.cc:648] HybridClock initialized: now 1786168731863415 us; error 53 us; skew 500 ppm
Aug 08 05:58:51 dist-test-slave-qg60 krb5kdc[21404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168731, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:51.866410 21660 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:58:51.867336 21660 webserver.cc:460] Webserver started at http://127.2.191.66:39897/ using document root <none> and password file <none>
I20260808 05:58:51.867921 21660 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:51.868019 21660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:51.868257 21660 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:51.870528 21660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "ed57a88dcdd84bd2943e9412c11bdc9e"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "c0c11c0f2506175917c4c1e2bcea138f"
server_key_iv: "210e6bcc4f5988159f054add39bc7d4a"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.871116 21660 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "ed57a88dcdd84bd2943e9412c11bdc9e"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "c0c11c0f2506175917c4c1e2bcea138f"
server_key_iv: "210e6bcc4f5988159f054add39bc7d4a"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.874929 21660 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:58:51.877517 21676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:51.878757 21660 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:58:51.878893 21660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "ed57a88dcdd84bd2943e9412c11bdc9e"
format_stamp: "Formatted at 2026-08-08 05:58:51 on dist-test-slave-qg60"
server_key: "c0c11c0f2506175917c4c1e2bcea138f"
server_key_iv: "210e6bcc4f5988159f054add39bc7d4a"
server_key_version: "encryptionkey@0"
I20260808 05:58:51.879009 21660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:51.902127 21660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:51.905256 21660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:51.905479 21660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:51.906116 21660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:51.906951 21660 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:51.906999 21660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:51.907048 21660 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:51.907064 21660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:51.916234 21660 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:43785
I20260808 05:58:51.916263 21795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:43785 every 8 connection(s)
I20260808 05:58:51.917224 21660 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:58:51.921989 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 21660
I20260808 05:58:51.922147 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:58:51.922438 2813 external_mini_cluster.cc:1428] Setting key eaeb36250f2c3d733deeebc896c039a5
Aug 08 05:58:51 dist-test-slave-qg60 krb5kdc[21404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168731, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:51.932749 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:51.919077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:34649 (local address 127.2.191.126:45129)
0808 05:58:51.919236 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:51.919241 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:51.920181 (+ 940us) server_negotiation.cc:407] Connection header received
0808 05:58:51.921132 (+ 951us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:51.921135 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:51.921187 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:51.921264 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:51.922632 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.923242 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.924666 (+ 1424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.925112 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.925234 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:51.928235 (+ 3001us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:51.928241 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:51.928247 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:51.928282 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:51.930138 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:51.930755 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:51.930759 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:51.930760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:51.930903 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:51.931519 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:51.931524 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:51.931528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:51.931779 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:51.931892 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:51.932411 (+ 519us) server_negotiation.cc:299] Negotiation successful
0808 05:58:51.932550 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:58:51.933594 21798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:51.919544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:45129 (local address 127.2.191.66:34649)
0808 05:58:51.920003 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:51.920060 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:51.920925 (+ 865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:51.921431 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:51.921438 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:51.921823 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:51.922417 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:51.922433 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.923376 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.923379 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:51.924515 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:51.924525 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:51.925446 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:51.925452 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:51.925685 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:51.926423 (+ 738us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:51.926450 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:51.928055 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:51.930263 (+ 2208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:51.930269 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:51.930282 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:51.930608 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:51.931107 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:51.931115 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:51.931117 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:51.931376 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:51.931891 (+ 515us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:51.931899 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:51.932166 (+ 267us) client_negotiation.cc:769] Sending connection context
0808 05:58:51.932368 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 05:58:51.932705 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":112,"threads_started":1}
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:58:51.934827 21796 heartbeater.cc:347] Connected to a master server at 127.2.191.126:45129
I20260808 05:58:51.935087 21796 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:51.935670 21796 heartbeater.cc:511] Master 127.2.191.126:45129 requested a full tablet report, sending...
I20260808 05:58:51.936857 21452 ts_manager.cc:194] Registered new tserver with Master: ed57a88dcdd84bd2943e9412c11bdc9e (127.2.191.66:43785)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:58:51.937693 21452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:34649
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:58:51.955571 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:45129
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:52.073271 21802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:52.073549 21802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:52.073594 21802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:52.078117 21802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:52.078191 21802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:52.078325 21802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:58:52.084087 21802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:45129
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:52.085251 21802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:52.086308 21802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:52.096467 21807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:52.096623 21802 server_base.cc:1034] running on GCE node
W20260808 05:58:52.096477 21808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:52.096467 21810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:52.097256 21802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:52.097966 21802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:52.099138 21802 hybrid_clock.cc:648] HybridClock initialized: now 1786168732099105 us; error 49 us; skew 500 ppm
Aug 08 05:58:52 dist-test-slave-qg60 krb5kdc[21404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168732, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:52.102476 21802 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:58:52.103713 21802 webserver.cc:460] Webserver started at http://127.2.191.67:38317/ using document root <none> and password file <none>
I20260808 05:58:52.104389 21802 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:52.104502 21802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:52.104795 21802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:52.106992 21802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "e82e487d5d144f079191839afe0a0143"
format_stamp: "Formatted at 2026-08-08 05:58:52 on dist-test-slave-qg60"
server_key: "163163122eb2b552adba185845462494"
server_key_iv: "31991f908f56dd6233eacc21e4e9056a"
server_key_version: "encryptionkey@0"
I20260808 05:58:52.107599 21802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "e82e487d5d144f079191839afe0a0143"
format_stamp: "Formatted at 2026-08-08 05:58:52 on dist-test-slave-qg60"
server_key: "163163122eb2b552adba185845462494"
server_key_iv: "31991f908f56dd6233eacc21e4e9056a"
server_key_version: "encryptionkey@0"
I20260808 05:58:52.111629 21802 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 05:58:52.114408 21817 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:52.115695 21802 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:58:52.115846 21802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "e82e487d5d144f079191839afe0a0143"
format_stamp: "Formatted at 2026-08-08 05:58:52 on dist-test-slave-qg60"
server_key: "163163122eb2b552adba185845462494"
server_key_iv: "31991f908f56dd6233eacc21e4e9056a"
server_key_version: "encryptionkey@0"
I20260808 05:58:52.115978 21802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:52.154464 21802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:52.158325 21802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:52.158563 21802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:52.159217 21802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:52.160107 21802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:52.160182 21802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:52.160255 21802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:52.160310 21802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:52.170605 21802 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:43975
I20260808 05:58:52.170627 21939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:43975 every 8 connection(s)
I20260808 05:58:52.171594 21802 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:58:52.174188 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 21802
I20260808 05:58:52.174350 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:58:52.174722 2813 external_mini_cluster.cc:1428] Setting key 3c1b493804989f78879032726f6c0ebe
Aug 08 05:58:52 dist-test-slave-qg60 krb5kdc[21404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168732, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:52.186218 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.173614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:53017 (local address 127.2.191.126:45129)
0808 05:58:52.173768 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.173771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.174811 (+ 1040us) server_negotiation.cc:407] Connection header received
0808 05:58:52.175925 (+ 1114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.175928 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.175997 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.176100 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:52.177437 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.177967 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.179139 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.179362 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.179472 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.182408 (+ 2936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:52.182411 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:52.182413 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:52.182446 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:52.184009 (+ 1563us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:52.184538 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:52.184543 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:52.184545 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:52.184635 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:52.185027 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:52.185031 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:52.185033 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:52.185292 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:52.185402 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.185902 (+ 500us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.186039 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 05:58:52.187057 21943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.174005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:45129 (local address 127.2.191.67:53017)
0808 05:58:52.174578 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:52.174649 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:52.175716 (+ 1067us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:52.176283 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:52.176290 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:52.176666 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:52.177291 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.177305 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.178107 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.178110 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.179006 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.179016 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.179524 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.179528 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.179703 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.180354 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:52.180379 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:52.182189 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:52.184134 (+ 1945us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:52.184141 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:52.184156 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:52.184419 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:52.184762 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:52.184765 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:52.184767 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:52.184909 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:52.185400 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:52.185407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:52.185649 (+ 242us) client_negotiation.cc:769] Sending connection context
0808 05:58:52.185842 (+ 193us) client_negotiation.cc:240] Negotiation successful
0808 05:58:52.186178 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":295,"thread_start_us":149,"threads_started":1}
I20260808 05:58:52.188198 21940 heartbeater.cc:347] Connected to a master server at 127.2.191.126:45129
I20260808 05:58:52.188463 21940 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:52.189061 21940 heartbeater.cc:511] Master 127.2.191.126:45129 requested a full tablet report, sending...
I20260808 05:58:52.190053 21452 ts_manager.cc:194] Registered new tserver with Master: e82e487d5d144f079191839afe0a0143 (127.2.191.67:43975)
I20260808 05:58:52.190604 21452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:53017
I20260808 05:58:52.200701 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:58:52.210944 21495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.202846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47014 (local address 127.2.191.126:45129)
0808 05:58:52.203084 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.203088 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.203231 (+ 143us) server_negotiation.cc:407] Connection header received
0808 05:58:52.203384 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.203389 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.203438 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.203525 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:52.204262 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.204840 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.205701 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.205922 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.206046 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.207611 (+ 1565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:52.207615 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:52.207618 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:52.207651 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:52.209148 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:52.209594 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:52.209603 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:52.209604 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:52.209681 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:52.209960 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:52.209964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:52.209966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:52.210243 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:52.210400 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.210640 (+ 240us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.210762 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260808 05:58:52.214272 21452 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47014:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:58:52.217428 21452 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:58:52.232656 21954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.226519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:43785 (local address 127.0.0.1:49062)
0808 05:58:52.227451 (+ 932us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:52.227504 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:52.227643 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:52.228345 (+ 702us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:52.228351 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:52.228373 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:52.228554 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.228562 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.229722 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.229728 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.231019 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.231030 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.232070 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.232073 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.232187 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.232226 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 05:58:52.232361 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 05:58:52.232493 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"mutex_wait_us":27,"thread_start_us":98,"threads_started":1}
I20260808 05:58:52.232666 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.226715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.2.191.66:43785)
0808 05:58:52.227820 (+ 1105us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.227832 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.227856 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:58:52.227937 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.227943 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.228173 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.228336 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:52.228692 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.229594 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.231131 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.231939 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.232061 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.232220 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.232396 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.232493 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":988,"thread_start_us":117,"threads_started":1}
I20260808 05:58:52.233220 21957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.227350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54450 (local address 127.2.191.65:42423)
0808 05:58:52.228060 (+ 710us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.228069 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.228092 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:58:52.228193 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.228198 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.228382 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.228570 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:52.228850 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.230086 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.231410 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.232111 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.232216 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.232348 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.232973 (+ 625us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.233083 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":115,"threads_started":1}
I20260808 05:58:52.233282 21955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.226714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:43975 (local address 127.0.0.1:41496)
0808 05:58:52.227716 (+ 1002us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:52.227730 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:52.227817 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:52.228781 (+ 964us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:52.228784 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:52.228802 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:52.228885 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.228891 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.230336 (+ 1445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.230340 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.231624 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.231635 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.232877 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.232882 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.232974 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.232998 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 05:58:52.233088 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:58:52.233151 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":935,"mutex_wait_us":52,"thread_start_us":112,"threads_started":1}
I20260808 05:58:52.233528 21956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.227297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41496 (local address 127.2.191.67:43975)
0808 05:58:52.228347 (+ 1050us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.228360 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.228382 (+ 22us) server_negotiation.cc:407] Connection header received
0808 05:58:52.228456 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.228461 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.228628 (+ 167us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.228811 (+ 183us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:52.228999 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.230169 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.231760 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.232560 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.232662 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.232815 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.233145 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.233254 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":953,"thread_start_us":141,"threads_started":1}
I20260808 05:58:52.232874 21952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.227167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:42423 (local address 127.0.0.1:54450)
0808 05:58:52.227879 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:52.227894 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:52.227966 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:52.228558 (+ 592us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:52.228561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:52.228580 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:52.228683 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.228693 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.230212 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.230216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.231296 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.231304 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.232416 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.232420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.232539 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.232565 (+ 26us) client_negotiation.cc:769] Sending connection context
0808 05:58:52.232639 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:58:52.232710 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":102,"threads_started":1}
I20260808 05:58:52.236446 21585 tablet_service.cc:1467] Processing CreateTablet for tablet ceb1a7698a4b40bb9f578b9f1fda0007 (DEFAULT_TABLE table=test-table [id=8c29a32c5ec141a887dbc4e63c9b29d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:52.236457 21870 tablet_service.cc:1467] Processing CreateTablet for tablet ceb1a7698a4b40bb9f578b9f1fda0007 (DEFAULT_TABLE table=test-table [id=8c29a32c5ec141a887dbc4e63c9b29d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:52.236457 21727 tablet_service.cc:1467] Processing CreateTablet for tablet ceb1a7698a4b40bb9f578b9f1fda0007 (DEFAULT_TABLE table=test-table [id=8c29a32c5ec141a887dbc4e63c9b29d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:52.237533 21585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb1a7698a4b40bb9f578b9f1fda0007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:52.237561 21727 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb1a7698a4b40bb9f578b9f1fda0007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:52.237561 21870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ceb1a7698a4b40bb9f578b9f1fda0007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:52.244030 21958 tablet_bootstrap.cc:492] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f: Bootstrap starting.
I20260808 05:58:52.245200 21959 tablet_bootstrap.cc:492] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Bootstrap starting.
I20260808 05:58:52.246518 21958 tablet_bootstrap.cc:654] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:52.247457 21958 log.cc:824] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:52.247761 21959 tablet_bootstrap.cc:654] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:52.248275 21960 tablet_bootstrap.cc:492] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Bootstrap starting.
I20260808 05:58:52.248603 21959 log.cc:824] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:52.249823 21958 tablet_bootstrap.cc:492] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f: No bootstrap required, opened a new log
I20260808 05:58:52.250029 21958 ts_tablet_manager.cc:1397] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 05:58:52.250420 21960 tablet_bootstrap.cc:654] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:52.250794 21959 tablet_bootstrap.cc:492] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: No bootstrap required, opened a new log
I20260808 05:58:52.251008 21959 ts_tablet_manager.cc:1397] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:58:52.251551 21960 log.cc:824] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:52.253275 21960 tablet_bootstrap.cc:492] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: No bootstrap required, opened a new log
I20260808 05:58:52.253477 21960 ts_tablet_manager.cc:1397] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.001s
I20260808 05:58:52.254798 21958 raft_consensus.cc:348] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.254916 21959 raft_consensus.cc:348] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.255105 21958 raft_consensus.cc:374] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:52.255133 21959 raft_consensus.cc:374] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:52.255187 21959 raft_consensus.cc:729] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed57a88dcdd84bd2943e9412c11bdc9e, State: Initialized, Role: FOLLOWER
I20260808 05:58:52.255206 21958 raft_consensus.cc:729] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77e6f8ae518c4da5a8cd4a7b252fbc2f, State: Initialized, Role: FOLLOWER
I20260808 05:58:52.255726 21958 consensus_queue.cc:260] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.256465 21655 heartbeater.cc:503] Master 127.2.191.126:45129 was elected leader, sending a full tablet report...
I20260808 05:58:52.256659 21959 consensus_queue.cc:260] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.256847 21958 ts_tablet_manager.cc:1428] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20260808 05:58:52.257419 21796 heartbeater.cc:503] Master 127.2.191.126:45129 was elected leader, sending a full tablet report...
I20260808 05:58:52.257606 21959 ts_tablet_manager.cc:1428] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20260808 05:58:52.258128 21960 raft_consensus.cc:348] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.258414 21960 raft_consensus.cc:374] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:52.258487 21960 raft_consensus.cc:729] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e82e487d5d144f079191839afe0a0143, State: Initialized, Role: FOLLOWER
I20260808 05:58:52.258929 21960 consensus_queue.cc:260] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.259667 21940 heartbeater.cc:503] Master 127.2.191.126:45129 was elected leader, sending a full tablet report...
I20260808 05:58:52.259960 21960 ts_tablet_manager.cc:1428] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Time spent starting tablet: real 0.006s user 0.001s sys 0.004s
W20260808 05:58:52.418417 21797 tablet.cc:2369] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:58:52.422622 21941 tablet.cc:2369] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:58:52.435511 21656 tablet.cc:2369] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:58:52.498474 21965 raft_consensus.cc:482] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:52.498736 21965 raft_consensus.cc:504] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.500123 21965 leader_election.cc:288] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e82e487d5d144f079191839afe0a0143 (127.2.191.67:43975), 77e6f8ae518c4da5a8cd4a7b252fbc2f (127.2.191.65:42423)
I20260808 05:58:52.504496 21957 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.500606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:34905 (local address 127.2.191.65:42423)
0808 05:58:52.500838 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.500844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.501060 (+ 216us) server_negotiation.cc:407] Connection header received
0808 05:58:52.501183 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.501185 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.501257 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.501335 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:52.501706 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.502289 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.503401 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.503847 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.503986 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.504050 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.504252 (+ 202us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.504343 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138}
I20260808 05:58:52.504534 21956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.500606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:46111 (local address 127.2.191.67:43975)
0808 05:58:52.500817 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.500822 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.500965 (+ 143us) server_negotiation.cc:407] Connection header received
0808 05:58:52.501091 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.501095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.501153 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.501227 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:52.501548 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.502202 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.503447 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.503850 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.503996 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.504060 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.504328 (+ 268us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.504411 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260808 05:58:52.504550 21969 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.500428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:42423 (local address 127.2.191.66:34905)
0808 05:58:52.500940 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:52.500955 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:52.501078 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:52.501408 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:52.501411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:52.501428 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:52.501582 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.501588 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.502462 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.502465 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.503272 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.503281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.503983 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.503986 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.504100 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.504166 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 05:58:52.504230 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:58:52.504333 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"mutex_wait_us":32,"thread_start_us":86,"threads_started":1}
I20260808 05:58:52.504562 21968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.500431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:43975 (local address 127.2.191.66:46111)
0808 05:58:52.500840 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:52.500857 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:52.500977 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:52.501264 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:52.501267 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:52.501287 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:52.501429 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.501436 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.502323 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.502330 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.503257 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:52.503268 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.503986 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.503990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:52.504179 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.504210 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 05:58:52.504294 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:58:52.504378 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"mutex_wait_us":65,"thread_start_us":105,"threads_started":1}
I20260808 05:58:52.505312 21607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb1a7698a4b40bb9f578b9f1fda0007" candidate_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" is_pre_election: true
I20260808 05:58:52.505537 21894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb1a7698a4b40bb9f578b9f1fda0007" candidate_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e82e487d5d144f079191839afe0a0143" is_pre_election: true
I20260808 05:58:52.505682 21607 raft_consensus.cc:2454] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed57a88dcdd84bd2943e9412c11bdc9e in term 0.
I20260808 05:58:52.505877 21894 raft_consensus.cc:2454] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed57a88dcdd84bd2943e9412c11bdc9e in term 0.
I20260808 05:58:52.506291 21680 leader_election.cc:302] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77e6f8ae518c4da5a8cd4a7b252fbc2f, ed57a88dcdd84bd2943e9412c11bdc9e; no voters:
I20260808 05:58:52.506646 21965 raft_consensus.cc:2781] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:58:52.506750 21965 raft_consensus.cc:482] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:58:52.506814 21965 raft_consensus.cc:3037] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:52.507920 21965 raft_consensus.cc:504] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.508301 21965 leader_election.cc:288] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [CANDIDATE]: Term 1 election: Requested vote from peers e82e487d5d144f079191839afe0a0143 (127.2.191.67:43975), 77e6f8ae518c4da5a8cd4a7b252fbc2f (127.2.191.65:42423)
I20260808 05:58:52.508687 21894 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb1a7698a4b40bb9f578b9f1fda0007" candidate_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e82e487d5d144f079191839afe0a0143"
I20260808 05:58:52.508765 21607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ceb1a7698a4b40bb9f578b9f1fda0007" candidate_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f"
I20260808 05:58:52.508859 21894 raft_consensus.cc:3037] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:52.509021 21607 raft_consensus.cc:3037] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:52.509991 21894 raft_consensus.cc:2454] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed57a88dcdd84bd2943e9412c11bdc9e in term 1.
I20260808 05:58:52.510181 21607 raft_consensus.cc:2454] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed57a88dcdd84bd2943e9412c11bdc9e in term 1.
I20260808 05:58:52.510358 21678 leader_election.cc:302] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e82e487d5d144f079191839afe0a0143, ed57a88dcdd84bd2943e9412c11bdc9e; no voters:
I20260808 05:58:52.510564 21965 raft_consensus.cc:2781] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:52.510896 21965 raft_consensus.cc:686] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 1 LEADER]: Becoming Leader. State: Replica: ed57a88dcdd84bd2943e9412c11bdc9e, State: Running, Role: LEADER
I20260808 05:58:52.511277 21965 consensus_queue.cc:237] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } }
I20260808 05:58:52.514804 21450 catalog_manager.cc:5495] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e reported cstate change: term changed from 0 to 1, leader changed from <none> to ed57a88dcdd84bd2943e9412c11bdc9e (127.2.191.66). New cstate: current_term: 1 leader_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed57a88dcdd84bd2943e9412c11bdc9e" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 43785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 } health_report { overall_health: UNKNOWN } } }
I20260808 05:58:52.596539 21953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.592825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49066 (local address 127.2.191.66:43785)
0808 05:58:52.593052 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.593059 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.593076 (+ 17us) server_negotiation.cc:407] Connection header received
0808 05:58:52.593167 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.593169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.593226 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.593350 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:58:52.593641 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.594163 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.595046 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.595267 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.595381 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.595707 (+ 326us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:58:52.596129 (+ 422us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:58:52.596270 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.596329 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.596389 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:58:52.602576 21607 raft_consensus.cc:1261] T ceb1a7698a4b40bb9f578b9f1fda0007 P 77e6f8ae518c4da5a8cd4a7b252fbc2f [term 1 FOLLOWER]: Refusing update from remote peer ed57a88dcdd84bd2943e9412c11bdc9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:52.602582 21894 raft_consensus.cc:1261] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 1 FOLLOWER]: Refusing update from remote peer ed57a88dcdd84bd2943e9412c11bdc9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:52.603351 21965 consensus_queue.cc:1035] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e82e487d5d144f079191839afe0a0143" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 43975 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:52.603559 21970 consensus_queue.cc:1035] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "77e6f8ae518c4da5a8cd4a7b252fbc2f" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 42423 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:52.611608 21975 mvcc.cc:205] Tried to move back new op lower bound from 7316147128732127232 to 7316147128369430528. Current Snapshot: MvccSnapshot[applied={T|T < 7316147128732127232}]
I20260808 05:58:52.614370 21974 mvcc.cc:205] Tried to move back new op lower bound from 7316147128732127232 to 7316147128369430528. Current Snapshot: MvccSnapshot[applied={T|T < 7316147128732127232}]
I20260808 05:58:52.619676 21451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:52.619876 21451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47014:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:52.622742 21451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1f18ca711a7a495fac67605712a9a0bf: Sending DeleteTablet for 3 replicas of tablet ceb1a7698a4b40bb9f578b9f1fda0007
I20260808 05:58:52.623705 21870 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb1a7698a4b40bb9f578b9f1fda0007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:41496
I20260808 05:58:52.623833 21585 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb1a7698a4b40bb9f578b9f1fda0007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:54450
I20260808 05:58:52.624248 21727 tablet_service.cc:1514] Processing DeleteTablet for tablet ceb1a7698a4b40bb9f578b9f1fda0007 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:52 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:49062
I20260808 05:58:52.624761 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 21518
I20260808 05:58:52.627545 21984 tablet_replica.cc:330] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: stopping tablet replica
I20260808 05:58:52.627935 21984 raft_consensus.cc:2229] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:58:52.628288 21984 raft_consensus.cc:2258] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:52.628679 21986 tablet_replica.cc:330] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: stopping tablet replica
I20260808 05:58:52.628997 21986 raft_consensus.cc:2229] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:58:52.629424 21986 raft_consensus.cc:2258] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:52.631017 21986 ts_tablet_manager.cc:1905] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:52.631029 21984 ts_tablet_manager.cc:1905] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:52.633898 21986 ts_tablet_manager.cc:1918] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:52.634076 21986 log.cc:1196] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/ceb1a7698a4b40bb9f578b9f1fda0007
I20260808 05:58:52.634488 21986 ts_tablet_manager.cc:1939] T ceb1a7698a4b40bb9f578b9f1fda0007 P ed57a88dcdd84bd2943e9412c11bdc9e: Deleting consensus metadata
I20260808 05:58:52.634534 21984 ts_tablet_manager.cc:1918] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:52.634716 21984 log.cc:1196] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/ceb1a7698a4b40bb9f578b9f1fda0007
I20260808 05:58:52.635097 21984 ts_tablet_manager.cc:1939] T ceb1a7698a4b40bb9f578b9f1fda0007 P e82e487d5d144f079191839afe0a0143: Deleting consensus metadata
I20260808 05:58:52.635793 21435 catalog_manager.cc:4841] TS ed57a88dcdd84bd2943e9412c11bdc9e (127.2.191.66:43785): tablet ceb1a7698a4b40bb9f578b9f1fda0007 (table test-table [id=8c29a32c5ec141a887dbc4e63c9b29d9]) successfully deleted
W20260808 05:58:52.636282 21438 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:42423 (error 108)
I20260808 05:58:52.636368 21436 catalog_manager.cc:4841] TS e82e487d5d144f079191839afe0a0143 (127.2.191.67:43975): tablet ceb1a7698a4b40bb9f578b9f1fda0007 (table test-table [id=8c29a32c5ec141a887dbc4e63c9b29d9]) successfully deleted
I20260808 05:58:52.637269 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 21660
I20260808 05:58:52.637445 21952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.637114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:42423 (local address 127.0.0.1:54464)
0808 05:58:52.637253 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:52.637341 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:42423: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260808 05:58:52.644906 21438 catalog_manager.cc:4584] TS 77e6f8ae518c4da5a8cd4a7b252fbc2f (127.2.191.65:42423): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ceb1a7698a4b40bb9f578b9f1fda0007: Network error: Client connection negotiation failed: client connection to 127.2.191.65:42423: connect: Connection refused (error 111)
I20260808 05:58:52.646142 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 21802
I20260808 05:58:52.653563 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 21418
2026-08-08T05:58:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2716 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T05:58:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:58:52Z Disabled control of system clock
I20260808 05:58:52.689157 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:41615
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:46489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:41615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:58:52.810284 21991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:52.810580 21991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:52.810619 21991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:52.814606 21991 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:58:52.814667 21991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:52.814683 21991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:52.814700 21991 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:58:52.814715 21991 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:58:52.819636 21991 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:46489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:41615
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:41615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:52.820854 21991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:52.822305 21991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:52.831122 21999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:52.831128 21997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:52.831264 21996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:52.831398 21991 server_base.cc:1034] running on GCE node
I20260808 05:58:52.832099 21991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:52.833307 21991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:52.834525 21991 hybrid_clock.cc:648] HybridClock initialized: now 1786168732834505 us; error 37 us; skew 500 ppm
I20260808 05:58:52.836648 21991 webserver.cc:460] Webserver started at http://127.2.191.126:35235/ using document root <none> and password file <none>
I20260808 05:58:52.837281 21991 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:52.837384 21991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:52.837634 21991 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:52.839802 21991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "f027716be8354836abe05d72a62e88ea"
format_stamp: "Formatted at 2026-08-08 05:58:52 on dist-test-slave-qg60"
server_key: "5486128b6a7b9b932e5432416f66e65b"
server_key_iv: "0b0cae33b1841593db77f599f155cdd0"
server_key_version: "encryptionkey@0"
I20260808 05:58:52.840410 21991 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "f027716be8354836abe05d72a62e88ea"
format_stamp: "Formatted at 2026-08-08 05:58:52 on dist-test-slave-qg60"
server_key: "5486128b6a7b9b932e5432416f66e65b"
server_key_iv: "0b0cae33b1841593db77f599f155cdd0"
server_key_version: "encryptionkey@0"
I20260808 05:58:52.844288 21991 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:58:52.847023 22005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:52.848286 21991 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:58:52.848435 21991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "f027716be8354836abe05d72a62e88ea"
format_stamp: "Formatted at 2026-08-08 05:58:52 on dist-test-slave-qg60"
server_key: "5486128b6a7b9b932e5432416f66e65b"
server_key_iv: "0b0cae33b1841593db77f599f155cdd0"
server_key_version: "encryptionkey@0"
I20260808 05:58:52.848558 21991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:52.861788 21991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:52.862537 21991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:52.862753 21991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:52.870165 21991 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:41615
I20260808 05:58:52.870194 22066 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:41615 every 8 connection(s)
I20260808 05:58:52.871152 21991 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:58:52.874459 22067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:52.875955 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 21991
I20260808 05:58:52.876112 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:58:52.876398 2813 external_mini_cluster.cc:1428] Setting key 7eac38a14051b1b9047e186b454ccc71
I20260808 05:58:52.881088 22067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea: Bootstrap starting.
I20260808 05:58:52.883306 22067 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:52.884208 22067 log.cc:824] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:52.886101 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:52.877949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53468 (local address 127.2.191.126:41615)
0808 05:58:52.878667 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:52.878684 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:52.878723 (+ 39us) server_negotiation.cc:407] Connection header received
0808 05:58:52.879393 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:52.879410 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:52.879812 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:52.880160 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:52.880612 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.881718 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.882626 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:52.883099 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:52.883271 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:52.884227 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:52.884232 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:52.884245 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:52.884698 (+ 453us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:52.884815 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:52.884838 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:52.884948 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:52.885123 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 05:58:52.885386 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":125,"threads_started":1}
I20260808 05:58:52.886363 22067 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea: No bootstrap required, opened a new log
I20260808 05:58:52.890681 22067 raft_consensus.cc:348] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f027716be8354836abe05d72a62e88ea" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41615 } }
I20260808 05:58:52.890937 22067 raft_consensus.cc:374] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:52.891024 22067 raft_consensus.cc:729] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f027716be8354836abe05d72a62e88ea, State: Initialized, Role: FOLLOWER
I20260808 05:58:52.891439 22067 consensus_queue.cc:260] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f027716be8354836abe05d72a62e88ea" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41615 } }
I20260808 05:58:52.891592 22067 raft_consensus.cc:388] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:58:52.891676 22067 raft_consensus.cc:482] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:58:52.891773 22067 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:52.892705 22067 raft_consensus.cc:504] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f027716be8354836abe05d72a62e88ea" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41615 } }
I20260808 05:58:52.893115 22067 leader_election.cc:302] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f027716be8354836abe05d72a62e88ea; no voters:
I20260808 05:58:52.893433 22067 leader_election.cc:288] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:58:52.893616 22072 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:52.893864 22072 raft_consensus.cc:686] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [term 1 LEADER]: Becoming Leader. State: Replica: f027716be8354836abe05d72a62e88ea, State: Running, Role: LEADER
I20260808 05:58:52.894199 22072 consensus_queue.cc:237] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f027716be8354836abe05d72a62e88ea" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41615 } }
I20260808 05:58:52.894696 22067 sys_catalog.cc:564] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:58:52.895998 22074 sys_catalog.cc:455] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [sys.catalog]: SysCatalogTable state changed. Reason: New leader f027716be8354836abe05d72a62e88ea. Latest consensus state: current_term: 1 leader_uuid: "f027716be8354836abe05d72a62e88ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f027716be8354836abe05d72a62e88ea" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41615 } } }
I20260808 05:58:52.896021 22073 sys_catalog.cc:455] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f027716be8354836abe05d72a62e88ea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f027716be8354836abe05d72a62e88ea" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41615 } } }
I20260808 05:58:52.896131 22073 sys_catalog.cc:458] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:52.896130 22074 sys_catalog.cc:458] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:52.896636 22081 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:58:52.899847 22081 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:58:52.905679 22081 catalog_manager.cc:1347] Generated new cluster ID: 18d02b9774554433b1d403e92bf44a9c
I20260808 05:58:52.905750 22081 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:58:52.939906 22081 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:58:52.940948 22081 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:58:52.948895 22081 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea: Generated new TSK 0
I20260808 05:58:52.949621 22081 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:58:52.952385 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41615
--builtin_ntp_servers=127.2.191.84:46489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:58:53.074855 22093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:53.075146 22093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:53.075187 22093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:53.079514 22093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:53.079582 22093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:53.079672 22093 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:58:53.087072 22093 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:46489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:53.088649 22093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:53.090667 22093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:53.101056 22098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:53.101068 22099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:53.101249 22093 server_base.cc:1034] running on GCE node
W20260808 05:58:53.101050 22101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:53.101852 22093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:53.102615 22093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:53.103847 22093 hybrid_clock.cc:648] HybridClock initialized: now 1786168733103821 us; error 42 us; skew 500 ppm
I20260808 05:58:53.106546 22093 webserver.cc:460] Webserver started at http://127.2.191.65:45257/ using document root <none> and password file <none>
I20260808 05:58:53.107411 22093 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:53.107530 22093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:53.107815 22093 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:53.110459 22093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "933e0cb0b542479da725784f2828f7e7"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "0ab2377c606affd05076a3c2f974b4b3"
server_key_iv: "c785eb127f093409948cb5bb4250be2b"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.111115 22093 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "933e0cb0b542479da725784f2828f7e7"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "0ab2377c606affd05076a3c2f974b4b3"
server_key_iv: "c785eb127f093409948cb5bb4250be2b"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.115175 22093 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:58:53.117744 22108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.119102 22093 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:53.119233 22093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "933e0cb0b542479da725784f2828f7e7"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "0ab2377c606affd05076a3c2f974b4b3"
server_key_iv: "c785eb127f093409948cb5bb4250be2b"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.119351 22093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:53.131439 22093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:53.132149 22093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:53.132347 22093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:53.133031 22093 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:53.134028 22093 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:53.134087 22093 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.134151 22093 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:53.134182 22093 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.143656 22093 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:46371
I20260808 05:58:53.143679 22231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:46371 every 8 connection(s)
I20260808 05:58:53.144677 22093 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:58:53.151213 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 22093
I20260808 05:58:53.151346 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:58:53.151643 2813 external_mini_cluster.cc:1428] Setting key 20981d564a40d5fa7a5c89e8d35e9e99
I20260808 05:58:53.153851 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41615
--builtin_ntp_servers=127.2.191.84:46489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:58:53.154724 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.146635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:52155 (local address 127.2.191.126:41615)
0808 05:58:53.146783 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.146786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.147880 (+ 1094us) server_negotiation.cc:407] Connection header received
0808 05:58:53.149486 (+ 1606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.149497 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.149556 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.149661 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:53.150543 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.151080 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.152537 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.152824 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.152957 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.154227 (+ 1270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:53.154230 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:53.154233 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:53.154244 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:53.154261 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:53.154270 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:53.154348 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.154518 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.154583 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:58:53.155584 22234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.147003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41615 (local address 127.2.191.65:52155)
0808 05:58:53.147723 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.147766 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:53.149273 (+ 1507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:53.149825 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:53.149832 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:53.149915 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:53.150394 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.150406 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.151209 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.151218 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.152414 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.152424 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.153025 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.153032 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.153198 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.153853 (+ 655us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:58:53.153855 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:53.153894 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:58:53.154069 (+ 175us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:53.154350 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:53.154362 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:53.154371 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 05:58:53.154508 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 05:58:53.154790 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":278,"thread_start_us":114,"threads_started":1}
I20260808 05:58:53.157017 22232 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41615
I20260808 05:58:53.157289 22232 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:53.157858 22232 heartbeater.cc:511] Master 127.2.191.126:41615 requested a full tablet report, sending...
I20260808 05:58:53.159708 22027 ts_manager.cc:194] Registered new tserver with Master: 933e0cb0b542479da725784f2828f7e7 (127.2.191.65:46371)
I20260808 05:58:53.161543 22027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.65:52155
W20260808 05:58:53.270474 22235 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:53.270751 22235 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:53.270792 22235 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:53.274847 22235 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:53.274906 22235 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:53.274964 22235 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:58:53.279633 22235 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:46489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:53.280849 22235 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:53.282261 22235 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:53.292141 22243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:53.292151 22240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:53.292236 22235 server_base.cc:1034] running on GCE node
W20260808 05:58:53.292151 22241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:53.292917 22235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:53.293653 22235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:53.294816 22235 hybrid_clock.cc:648] HybridClock initialized: now 1786168733294783 us; error 48 us; skew 500 ppm
I20260808 05:58:53.297034 22235 webserver.cc:460] Webserver started at http://127.2.191.66:45313/ using document root <none> and password file <none>
I20260808 05:58:53.298146 22235 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:53.298234 22235 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:53.298425 22235 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:53.300668 22235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "5fac7f6f2e02490ebadd1faed11d4687"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "9dc0010aa4c031f1ea44a9b65f3e4db8"
server_key_iv: "f86bfdbb2d9f1e166f329a32cb3be139"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.301360 22235 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "5fac7f6f2e02490ebadd1faed11d4687"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "9dc0010aa4c031f1ea44a9b65f3e4db8"
server_key_iv: "f86bfdbb2d9f1e166f329a32cb3be139"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.305255 22235 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:58:53.307716 22249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.309096 22235 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:58:53.309224 22235 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "5fac7f6f2e02490ebadd1faed11d4687"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "9dc0010aa4c031f1ea44a9b65f3e4db8"
server_key_iv: "f86bfdbb2d9f1e166f329a32cb3be139"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.309338 22235 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:53.321206 22235 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:53.321930 22235 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:53.322134 22235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:53.322805 22235 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:53.323832 22235 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:53.323899 22235 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.323966 22235 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:53.324038 22235 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.333274 22235 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:42409
I20260808 05:58:53.333303 22367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:42409 every 8 connection(s)
I20260808 05:58:53.334227 22235 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:58:53.342087 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 22235
I20260808 05:58:53.342232 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:58:53.342615 2813 external_mini_cluster.cc:1428] Setting key b7ea2b208eea1bdbc06e839c75146792
I20260808 05:58:53.343724 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.336051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:52233 (local address 127.2.191.126:41615)
0808 05:58:53.336208 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.336212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.337307 (+ 1095us) server_negotiation.cc:407] Connection header received
0808 05:58:53.338652 (+ 1345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.338655 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.338708 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.338788 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:53.339701 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.340227 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.341524 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.341741 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.341825 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.343177 (+ 1352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:53.343183 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:53.343187 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:53.343203 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:53.343228 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:53.343246 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:53.343309 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.343523 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.343588 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 05:58:53.344573 22371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.336404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41615 (local address 127.2.191.66:52233)
0808 05:58:53.337143 (+ 739us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.337187 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:53.338446 (+ 1259us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:53.338952 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:53.338958 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:53.339089 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:53.339567 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.339578 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.340341 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.340344 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.341415 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.341425 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.341899 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.341903 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.342169 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.342898 (+ 729us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:58:53.342900 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:53.342940 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:58:53.343007 (+ 67us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:53.343351 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:53.343360 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:53.343366 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:58:53.343498 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 05:58:53.343726 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"thread_start_us":140,"threads_started":1}
I20260808 05:58:53.344875 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41615
--builtin_ntp_servers=127.2.191.84:46489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:58:53.345849 22368 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41615
I20260808 05:58:53.346097 22368 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:53.346758 22368 heartbeater.cc:511] Master 127.2.191.126:41615 requested a full tablet report, sending...
I20260808 05:58:53.347899 22027 ts_manager.cc:194] Registered new tserver with Master: 5fac7f6f2e02490ebadd1faed11d4687 (127.2.191.66:42409)
I20260808 05:58:53.348503 22027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.66:52233
W20260808 05:58:53.462360 22372 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:53.462687 22372 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:53.462762 22372 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:53.466948 22372 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:53.467052 22372 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:53.467193 22372 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:58:53.472028 22372 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:46489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:41615
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22372
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:53.473248 22372 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:53.474726 22372 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:53.484419 22380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:53.484421 22378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:53.484421 22377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:53.484702 22372 server_base.cc:1034] running on GCE node
I20260808 05:58:53.485281 22372 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:53.485989 22372 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:53.487186 22372 hybrid_clock.cc:648] HybridClock initialized: now 1786168733487171 us; error 27 us; skew 500 ppm
I20260808 05:58:53.489246 22372 webserver.cc:460] Webserver started at http://127.2.191.67:40735/ using document root <none> and password file <none>
I20260808 05:58:53.489847 22372 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:53.489946 22372 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:53.490187 22372 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:53.492412 22372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "4f7ea9f939354fe1a15db01c61f8691b"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "a96f8b018e55007ce5b12099c7b859a2"
server_key_iv: "8671160e622c289fe541a6bf33618dfb"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.493036 22372 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "4f7ea9f939354fe1a15db01c61f8691b"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "a96f8b018e55007ce5b12099c7b859a2"
server_key_iv: "8671160e622c289fe541a6bf33618dfb"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.497098 22372 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 05:58:53.499716 22387 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.501068 22372 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:58:53.501204 22372 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "4f7ea9f939354fe1a15db01c61f8691b"
format_stamp: "Formatted at 2026-08-08 05:58:53 on dist-test-slave-qg60"
server_key: "a96f8b018e55007ce5b12099c7b859a2"
server_key_iv: "8671160e622c289fe541a6bf33618dfb"
server_key_version: "encryptionkey@0"
I20260808 05:58:53.501345 22372 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:53.515662 22372 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:53.516386 22372 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:53.516605 22372 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:53.517241 22372 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:53.518218 22372 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:53.518290 22372 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.518355 22372 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:53.518407 22372 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:53.528030 22372 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:40451
I20260808 05:58:53.528064 22508 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:40451 every 8 connection(s)
I20260808 05:58:53.529029 22372 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:58:53.532881 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 22372
I20260808 05:58:53.533082 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:58:53.533372 2813 external_mini_cluster.cc:1428] Setting key 8345a12ba47f2a56cf9b0ab3ed927388
I20260808 05:58:53.538794 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.530857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:33097 (local address 127.2.191.126:41615)
0808 05:58:53.531014 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.531019 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.532197 (+ 1178us) server_negotiation.cc:407] Connection header received
0808 05:58:53.533807 (+ 1610us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.533810 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.533870 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.533956 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:53.534862 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.535492 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.536674 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.536991 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.537115 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.538277 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:53.538281 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:53.538283 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:53.538296 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:53.538316 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:53.538334 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:53.538412 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.538586 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.538650 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:58:53.539680 22511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.531384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:41615 (local address 127.2.191.67:33097)
0808 05:58:53.532034 (+ 650us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.532080 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:53.533584 (+ 1504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:53.534133 (+ 549us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:53.534140 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:53.534228 (+ 88us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:53.534717 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.534730 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.535641 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.535644 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.536542 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.536552 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.537156 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.537160 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.537325 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.538004 (+ 679us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:58:53.538006 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:53.538050 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:58:53.538116 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:53.538428 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:53.538445 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:53.538451 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:58:53.538585 (+ 134us) client_negotiation.cc:240] Negotiation successful
0808 05:58:53.538883 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":269,"thread_start_us":118,"threads_started":1}
I20260808 05:58:53.540940 22509 heartbeater.cc:347] Connected to a master server at 127.2.191.126:41615
I20260808 05:58:53.541198 22509 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:53.541765 22509 heartbeater.cc:511] Master 127.2.191.126:41615 requested a full tablet report, sending...
I20260808 05:58:53.542871 22027 ts_manager.cc:194] Registered new tserver with Master: 4f7ea9f939354fe1a15db01c61f8691b (127.2.191.67:40451)
I20260808 05:58:53.543399 22027 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.67:33097
I20260808 05:58:53.547245 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:58:53.552947 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.549382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55116 (local address 127.2.191.126:41615)
0808 05:58:53.549500 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.549504 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.549692 (+ 188us) server_negotiation.cc:407] Connection header received
0808 05:58:53.549789 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.549791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.549831 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.549912 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:53.550141 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.550639 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.551454 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.551656 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.551729 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.552463 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:53.552466 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:53.552468 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:53.552479 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:53.552496 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:53.552504 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:53.552560 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.552708 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.552809 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:58:53.555761 22027 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55116:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:58:53.559020 22027 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:58:53.574239 22520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.568215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:40451 (local address 127.0.0.1:45646)
0808 05:58:53.568612 (+ 397us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.568673 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:53.568845 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:53.569899 (+ 1054us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:53.569905 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:53.569924 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:53.570090 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.570097 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.571371 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.571374 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.572527 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.572538 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.573698 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.573701 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.573808 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.573843 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 05:58:53.573946 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 05:58:53.574073 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":123,"threads_started":1}
I20260808 05:58:53.574250 22521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.568420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45646 (local address 127.2.191.67:40451)
0808 05:58:53.569103 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.569127 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.569156 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:58:53.569239 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.569247 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.569466 (+ 219us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.570197 (+ 731us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:53.570357 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.571247 (+ 890us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.572673 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.573517 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.573697 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.573909 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.573972 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.574075 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":139,"threads_started":1}
I20260808 05:58:53.574682 22523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.568567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:46371 (local address 127.0.0.1:36408)
0808 05:58:53.569342 (+ 775us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.569355 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:53.569447 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:53.570326 (+ 879us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:53.570333 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:53.570356 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:53.570451 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.570458 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.571956 (+ 1498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.571959 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.573250 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.573260 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.574277 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.574281 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.574366 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.574388 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 05:58:53.574443 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 05:58:53.574507 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":714,"mutex_wait_us":86,"thread_start_us":150,"threads_started":1}
I20260808 05:58:53.574826 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.569052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:42409 (local address 127.0.0.1:52520)
0808 05:58:53.569550 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.569563 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:53.569635 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:53.570484 (+ 849us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:53.570487 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:53.570514 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:53.570604 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.570611 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.571990 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.571992 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.573144 (+ 1152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.573154 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.574463 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.574466 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.574538 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.574559 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 05:58:53.574633 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:58:53.574695 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"mutex_wait_us":58,"thread_start_us":96,"threads_started":1}
I20260808 05:58:53.575021 22525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.569460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.2.191.66:42409)
0808 05:58:53.569945 (+ 485us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.569956 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.569980 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:58:53.570055 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.570060 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.570256 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.570433 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:53.570744 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.571853 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.573271 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.574089 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.574213 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.574403 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.574694 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.574829 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":182,"threads_started":1}
I20260808 05:58:53.576402 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.569126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36408 (local address 127.2.191.65:46371)
0808 05:58:53.569833 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.569841 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.569885 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:58:53.569962 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.569967 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.570174 (+ 207us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.570322 (+ 148us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:53.570618 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.571823 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.573380 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.574141 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.575896 (+ 1755us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.576088 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.576142 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.576240 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":622,"thread_start_us":132,"threads_started":1}
I20260808 05:58:53.578224 22439 tablet_service.cc:1467] Processing CreateTablet for tablet e5f2bf5872ac4ef6a8f21e43545d265d (DEFAULT_TABLE table=test-table [id=365ec35325d747c59ac343d898667bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:53.578223 22300 tablet_service.cc:1467] Processing CreateTablet for tablet e5f2bf5872ac4ef6a8f21e43545d265d (DEFAULT_TABLE table=test-table [id=365ec35325d747c59ac343d898667bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:53.579416 22300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f2bf5872ac4ef6a8f21e43545d265d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:53.579416 22439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f2bf5872ac4ef6a8f21e43545d265d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:53.580876 22162 tablet_service.cc:1467] Processing CreateTablet for tablet e5f2bf5872ac4ef6a8f21e43545d265d (DEFAULT_TABLE table=test-table [id=365ec35325d747c59ac343d898667bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:53.581691 22162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5f2bf5872ac4ef6a8f21e43545d265d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:53.587069 22527 tablet_bootstrap.cc:492] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Bootstrap starting.
I20260808 05:58:53.587525 22526 tablet_bootstrap.cc:492] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: Bootstrap starting.
I20260808 05:58:53.587855 22528 tablet_bootstrap.cc:492] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7: Bootstrap starting.
I20260808 05:58:53.590142 22527 tablet_bootstrap.cc:654] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:53.590142 22528 tablet_bootstrap.cc:654] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:53.590529 22526 tablet_bootstrap.cc:654] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:53.590945 22528 log.cc:824] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:53.591074 22527 log.cc:824] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:53.591276 22526 log.cc:824] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:53.593206 22528 tablet_bootstrap.cc:492] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7: No bootstrap required, opened a new log
I20260808 05:58:53.593207 22527 tablet_bootstrap.cc:492] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: No bootstrap required, opened a new log
I20260808 05:58:53.593407 22528 ts_tablet_manager.cc:1397] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260808 05:58:53.593407 22527 ts_tablet_manager.cc:1397] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.004s
I20260808 05:58:53.593720 22526 tablet_bootstrap.cc:492] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: No bootstrap required, opened a new log
I20260808 05:58:53.593912 22526 ts_tablet_manager.cc:1397] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 05:58:53.597533 22526 raft_consensus.cc:348] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.597790 22526 raft_consensus.cc:374] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:53.597843 22526 raft_consensus.cc:729] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fac7f6f2e02490ebadd1faed11d4687, State: Initialized, Role: FOLLOWER
I20260808 05:58:53.597862 22527 raft_consensus.cc:348] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.597862 22528 raft_consensus.cc:348] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.598119 22528 raft_consensus.cc:374] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:53.598114 22527 raft_consensus.cc:374] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:53.598172 22528 raft_consensus.cc:729] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 933e0cb0b542479da725784f2828f7e7, State: Initialized, Role: FOLLOWER
I20260808 05:58:53.598173 22527 raft_consensus.cc:729] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f7ea9f939354fe1a15db01c61f8691b, State: Initialized, Role: FOLLOWER
I20260808 05:58:53.598336 22526 consensus_queue.cc:260] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.598614 22527 consensus_queue.cc:260] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.598614 22528 consensus_queue.cc:260] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.599210 22368 heartbeater.cc:503] Master 127.2.191.126:41615 was elected leader, sending a full tablet report...
I20260808 05:58:53.599428 22526 ts_tablet_manager.cc:1428] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20260808 05:58:53.599581 22527 ts_tablet_manager.cc:1428] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:58:53.599576 22528 ts_tablet_manager.cc:1428] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:58:53.599906 22232 heartbeater.cc:503] Master 127.2.191.126:41615 was elected leader, sending a full tablet report...
I20260808 05:58:53.599918 22509 heartbeater.cc:503] Master 127.2.191.126:41615 was elected leader, sending a full tablet report...
W20260808 05:58:53.646097 22233 tablet.cc:2369] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:58:53.753186 22532 raft_consensus.cc:482] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:53.753414 22532 raft_consensus.cc:504] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.754635 22532 leader_election.cc:288] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4f7ea9f939354fe1a15db01c61f8691b (127.2.191.67:40451), 933e0cb0b542479da725784f2828f7e7 (127.2.191.65:46371)
I20260808 05:58:53.758982 22521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.755028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:37547 (local address 127.2.191.67:40451)
0808 05:58:53.755175 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.755179 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.755196 (+ 17us) server_negotiation.cc:407] Connection header received
0808 05:58:53.755395 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.755400 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.755470 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.755605 (+ 135us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:53.756000 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.756641 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.757871 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.758386 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.758480 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.758526 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.758775 (+ 249us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.758848 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:58:53.758961 22371 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.754888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:40451 (local address 127.2.191.66:37547)
0808 05:58:53.755078 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.755096 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:53.755208 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:53.755674 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:53.755679 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:53.755713 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:53.755868 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.755876 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.756788 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.756792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.757735 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.757745 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.758511 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.758514 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.758613 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.758641 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 05:58:53.758729 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 05:58:53.758807 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":1,"spinlock_wait_cycles":2304}
I20260808 05:58:53.759254 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.754901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:46371 (local address 127.2.191.66:49459)
0808 05:58:53.755581 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.755598 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:53.755701 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:53.755992 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:53.755995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:53.756082 (+ 87us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:53.756208 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.756215 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.757125 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.757128 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.758053 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:53.758063 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.758811 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.758815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:53.758908 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.758929 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 05:58:53.759019 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:58:53.759088 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"mutex_wait_us":311,"thread_start_us":129,"threads_started":1}
I20260808 05:58:53.759263 22524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.755010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:49459 (local address 127.2.191.65:46371)
0808 05:58:53.755150 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.755155 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.755697 (+ 542us) server_negotiation.cc:407] Connection header received
0808 05:58:53.755820 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.755826 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.755883 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.755974 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:53.756365 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.757018 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.758182 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.758682 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.758797 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.758839 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.759048 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.759124 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:58:53.759745 22461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f2bf5872ac4ef6a8f21e43545d265d" candidate_uuid: "5fac7f6f2e02490ebadd1faed11d4687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7ea9f939354fe1a15db01c61f8691b" is_pre_election: true
I20260808 05:58:53.759997 22183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f2bf5872ac4ef6a8f21e43545d265d" candidate_uuid: "5fac7f6f2e02490ebadd1faed11d4687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "933e0cb0b542479da725784f2828f7e7" is_pre_election: true
I20260808 05:58:53.760134 22461 raft_consensus.cc:2454] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fac7f6f2e02490ebadd1faed11d4687 in term 0.
I20260808 05:58:53.760306 22183 raft_consensus.cc:2454] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fac7f6f2e02490ebadd1faed11d4687 in term 0.
I20260808 05:58:53.760758 22250 leader_election.cc:302] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4f7ea9f939354fe1a15db01c61f8691b, 5fac7f6f2e02490ebadd1faed11d4687; no voters:
I20260808 05:58:53.761053 22532 raft_consensus.cc:2781] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:58:53.761147 22532 raft_consensus.cc:482] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:58:53.761179 22532 raft_consensus.cc:3037] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:53.762456 22532 raft_consensus.cc:504] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.762836 22532 leader_election.cc:288] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [CANDIDATE]: Term 1 election: Requested vote from peers 4f7ea9f939354fe1a15db01c61f8691b (127.2.191.67:40451), 933e0cb0b542479da725784f2828f7e7 (127.2.191.65:46371)
I20260808 05:58:53.763196 22183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f2bf5872ac4ef6a8f21e43545d265d" candidate_uuid: "5fac7f6f2e02490ebadd1faed11d4687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "933e0cb0b542479da725784f2828f7e7"
I20260808 05:58:53.763239 22461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5f2bf5872ac4ef6a8f21e43545d265d" candidate_uuid: "5fac7f6f2e02490ebadd1faed11d4687" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4f7ea9f939354fe1a15db01c61f8691b"
I20260808 05:58:53.763301 22183 raft_consensus.cc:3037] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:53.763391 22461 raft_consensus.cc:3037] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:53.764380 22183 raft_consensus.cc:2454] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fac7f6f2e02490ebadd1faed11d4687 in term 1.
I20260808 05:58:53.764518 22461 raft_consensus.cc:2454] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fac7f6f2e02490ebadd1faed11d4687 in term 1.
I20260808 05:58:53.764809 22252 leader_election.cc:302] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5fac7f6f2e02490ebadd1faed11d4687, 933e0cb0b542479da725784f2828f7e7; no voters:
I20260808 05:58:53.765038 22532 raft_consensus.cc:2781] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:53.765246 22532 raft_consensus.cc:686] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 1 LEADER]: Becoming Leader. State: Replica: 5fac7f6f2e02490ebadd1faed11d4687, State: Running, Role: LEADER
I20260808 05:58:53.765652 22532 consensus_queue.cc:237] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } }
I20260808 05:58:53.769176 22024 catalog_manager.cc:5495] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fac7f6f2e02490ebadd1faed11d4687 (127.2.191.66). New cstate: current_term: 1 leader_uuid: "5fac7f6f2e02490ebadd1faed11d4687" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5fac7f6f2e02490ebadd1faed11d4687" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 42409 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 } health_report { overall_health: UNKNOWN } } }
W20260808 05:58:53.780017 22510 tablet.cc:2369] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:58:53.817224 22525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.813579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52534 (local address 127.2.191.66:42409)
0808 05:58:53.813716 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:53.813719 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:53.813731 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:58:53.813810 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:53.813812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:53.813874 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:53.814004 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:58:53.814277 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.814783 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.815643 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:53.815864 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:53.815976 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:53.816307 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:58:53.816753 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:58:53.816921 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:53.817004 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 05:58:53.817067 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:58:53.823796 22461 raft_consensus.cc:1261] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 1 FOLLOWER]: Refusing update from remote peer 5fac7f6f2e02490ebadd1faed11d4687: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:53.823776 22183 raft_consensus.cc:1261] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7 [term 1 FOLLOWER]: Refusing update from remote peer 5fac7f6f2e02490ebadd1faed11d4687: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:53.824545 22532 consensus_queue.cc:1035] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4f7ea9f939354fe1a15db01c61f8691b" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 40451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:53.824791 22536 consensus_queue.cc:1035] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [LEADER]: Connected to new peer: Peer: permanent_uuid: "933e0cb0b542479da725784f2828f7e7" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:53.838196 22541 mvcc.cc:205] Tried to move back new op lower bound from 7316147133734043648 to 7316147133506699264. Current Snapshot: MvccSnapshot[applied={T|T < 7316147133734043648 or (T in {7316147133734043648})}]
I20260808 05:58:53.841737 22024 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:55116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:53.841888 22024 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:55116:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:53.844512 22024 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f027716be8354836abe05d72a62e88ea: Sending DeleteTablet for 3 replicas of tablet e5f2bf5872ac4ef6a8f21e43545d265d
I20260808 05:58:53.845332 22162 tablet_service.cc:1514] Processing DeleteTablet for tablet e5f2bf5872ac4ef6a8f21e43545d265d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:53 UTC) from {username='slave'} at 127.0.0.1:36408
I20260808 05:58:53.845508 22300 tablet_service.cc:1514] Processing DeleteTablet for tablet e5f2bf5872ac4ef6a8f21e43545d265d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:53 UTC) from {username='slave'} at 127.0.0.1:52520
I20260808 05:58:53.845489 22439 tablet_service.cc:1514] Processing DeleteTablet for tablet e5f2bf5872ac4ef6a8f21e43545d265d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:53 UTC) from {username='slave'} at 127.0.0.1:45646
I20260808 05:58:53.845968 22554 tablet_replica.cc:330] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: stopping tablet replica
I20260808 05:58:53.846166 22551 tablet_replica.cc:330] T e5f2bf5872ac4ef6a8f21e43545d265d P 933e0cb0b542479da725784f2828f7e7: stopping tablet replica
I20260808 05:58:53.846313 22554 raft_consensus.cc:2229] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:58:53.846410 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 22093
I20260808 05:58:53.847996 22554 raft_consensus.cc:2258] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:53.849987 22554 ts_tablet_manager.cc:1905] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:53.851444 22552 tablet_replica.cc:330] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: stopping tablet replica
I20260808 05:58:53.851807 22552 raft_consensus.cc:2229] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:58:53.852293 22552 raft_consensus.cc:2258] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:53.853797 22552 ts_tablet_manager.cc:1905] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:53.854132 22554 ts_tablet_manager.cc:1918] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:53.854233 22554 log.cc:1196] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/e5f2bf5872ac4ef6a8f21e43545d265d
I20260808 05:58:53.854548 22554 ts_tablet_manager.cc:1939] T e5f2bf5872ac4ef6a8f21e43545d265d P 4f7ea9f939354fe1a15db01c61f8691b: Deleting consensus metadata
I20260808 05:58:53.855944 22006 catalog_manager.cc:4841] TS 4f7ea9f939354fe1a15db01c61f8691b (127.2.191.67:40451): tablet e5f2bf5872ac4ef6a8f21e43545d265d (table test-table [id=365ec35325d747c59ac343d898667bd3]) successfully deleted
I20260808 05:58:53.856657 22552 ts_tablet_manager.cc:1918] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:53.856817 22552 log.cc:1196] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/e5f2bf5872ac4ef6a8f21e43545d265d
I20260808 05:58:53.857137 22552 ts_tablet_manager.cc:1939] T e5f2bf5872ac4ef6a8f21e43545d265d P 5fac7f6f2e02490ebadd1faed11d4687: Deleting consensus metadata
I20260808 05:58:53.858217 22006 catalog_manager.cc:4841] TS 5fac7f6f2e02490ebadd1faed11d4687 (127.2.191.66:42409): tablet e5f2bf5872ac4ef6a8f21e43545d265d (table test-table [id=365ec35325d747c59ac343d898667bd3]) successfully deleted
W20260808 05:58:53.858596 22008 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:46371 (error 108)
I20260808 05:58:53.859215 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 22235
I20260808 05:58:53.859772 22522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:53.859443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:46371 (local address 127.0.0.1:36422)
0808 05:58:53.859624 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:53.859690 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:46371: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
W20260808 05:58:53.859915 22008 catalog_manager.cc:4584] TS 933e0cb0b542479da725784f2828f7e7 (127.2.191.65:46371): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e5f2bf5872ac4ef6a8f21e43545d265d: Network error: Client connection negotiation failed: client connection to 127.2.191.65:46371: connect: Connection refused (error 111)
I20260808 05:58:53.867488 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 22372
I20260808 05:58:53.875500 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 21991
2026-08-08T05:58:53Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (1220 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:58:53 dist-test-slave-qg60 krb5kdc[22558](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:58:53 dist-test-slave-qg60 krb5kdc[22558](info): set up 2 sockets
Aug 08 05:58:53 dist-test-slave-qg60 krb5kdc[22558](info): commencing operation
krb5kdc: starting...
W20260808 05:58:54.968506 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:58:55 dist-test-slave-qg60 krb5kdc[22558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:58:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:58:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:58:55.104229 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44531
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:38307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:44531
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:55.224529 22571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:55.224939 22571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:55.225026 22571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:55.229267 22571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:58:55.229382 22571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:55.229417 22571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:55.229449 22571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:58:55.229485 22571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:58:55.235468 22571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:44531
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44531
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:55.236658 22571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:55.237941 22571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:55.246843 22578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:55.246865 22577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:55.246949 22571 server_base.cc:1034] running on GCE node
W20260808 05:58:55.246843 22581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:55.247759 22571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:55.248970 22571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:55.250166 22571 hybrid_clock.cc:648] HybridClock initialized: now 1786168735250130 us; error 47 us; skew 500 ppm
Aug 08 05:58:55 dist-test-slave-qg60 krb5kdc[22558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168735, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:55.257740 22571 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:58:55.258759 22571 webserver.cc:460] Webserver started at http://127.2.191.126:45321/ using document root <none> and password file <none>
I20260808 05:58:55.259382 22571 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:55.259485 22571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:55.259760 22571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:55.262063 22571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "68e07860a2f64724b758c4e580acb302"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "ee1924d7ce6abfd851fc8c3ae1e9dabc"
server_key_iv: "f739a493e7d5bda2c6dea8800dfd1f7c"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.262676 22571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "68e07860a2f64724b758c4e580acb302"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "ee1924d7ce6abfd851fc8c3ae1e9dabc"
server_key_iv: "f739a493e7d5bda2c6dea8800dfd1f7c"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.266508 22571 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20260808 05:58:55.269264 22588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:55.270907 22571 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:55.271059 22571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "68e07860a2f64724b758c4e580acb302"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "ee1924d7ce6abfd851fc8c3ae1e9dabc"
server_key_iv: "f739a493e7d5bda2c6dea8800dfd1f7c"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.271209 22571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:55.287539 22571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:55.291431 22571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:55.291674 22571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:55.301481 22571 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:44531
I20260808 05:58:55.301508 22644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:44531 every 8 connection(s)
I20260808 05:58:55.302897 22571 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:58:55.306962 22645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:55.311916 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 22571
I20260808 05:58:55.312067 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:58:55.312361 2813 external_mini_cluster.cc:1428] Setting key c4330efde44095f27bd6a610cbc3f096
I20260808 05:58:55.315378 22645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302: Bootstrap starting.
I20260808 05:58:55.318758 22645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:55.319823 22645 log.cc:824] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:55.322484 22645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302: No bootstrap required, opened a new log
Aug 08 05:58:55 dist-test-slave-qg60 krb5kdc[22558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:55.327975 22645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e07860a2f64724b758c4e580acb302" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44531 } }
I20260808 05:58:55.328320 22645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:55.328385 22645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68e07860a2f64724b758c4e580acb302, State: Initialized, Role: FOLLOWER
I20260808 05:58:55.328976 22645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e07860a2f64724b758c4e580acb302" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44531 } }
I20260808 05:58:55.329159 22645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:58:55.329234 22645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:58:55.329344 22645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:55.330595 22645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e07860a2f64724b758c4e580acb302" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44531 } }
I20260808 05:58:55.330981 22645 leader_election.cc:302] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68e07860a2f64724b758c4e580acb302; no voters:
I20260808 05:58:55.331362 22645 leader_election.cc:288] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:58:55.331548 22650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:55.331823 22650 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [term 1 LEADER]: Becoming Leader. State: Replica: 68e07860a2f64724b758c4e580acb302, State: Running, Role: LEADER
I20260808 05:58:55.332187 22650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e07860a2f64724b758c4e580acb302" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44531 } }
I20260808 05:58:55.332672 22645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:58:55.332857 22648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:55.314333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34994 (local address 127.2.191.126:44531)
0808 05:58:55.314843 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:55.314862 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:55.314908 (+ 46us) server_negotiation.cc:407] Connection header received
0808 05:58:55.315832 (+ 924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:55.315856 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:55.316303 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:55.317730 (+ 1427us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:55.318191 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.319743 (+ 1552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.321018 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.321710 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.322303 (+ 593us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:55.326939 (+ 4636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:55.326946 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:55.326968 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:55.327003 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:55.329240 (+ 2237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:55.329813 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:55.329819 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:55.329826 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:55.329967 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:55.330306 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:55.330310 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:55.330312 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:55.330885 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:55.331087 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:55.331406 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 05:58:55.331743 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":171,"threads_started":1}
I20260808 05:58:55.333935 22652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68e07860a2f64724b758c4e580acb302. Latest consensus state: current_term: 1 leader_uuid: "68e07860a2f64724b758c4e580acb302" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e07860a2f64724b758c4e580acb302" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44531 } } }
I20260808 05:58:55.334080 22652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:55.334422 22651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68e07860a2f64724b758c4e580acb302" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68e07860a2f64724b758c4e580acb302" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44531 } } }
I20260808 05:58:55.334523 22651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302 [sys.catalog]: This master's current role is: LEADER
W20260808 05:58:55.337366 22666 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:58:55.337446 22666 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:58:55.337510 22660 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:58:55.338258 22660 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:58:55.343830 22660 catalog_manager.cc:1347] Generated new cluster ID: cf89b2f973e44031bfd4c736b61ba4be
I20260808 05:58:55.343895 22660 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:58:55.353813 22660 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:58:55.354736 22660 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:58:55.360069 22660 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302: Generated new TSK 0
I20260808 05:58:55.360880 22660 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:58:55.391784 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44531
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:38307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:55.507682 22673 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:55.508059 22673 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:55.508140 22673 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:55.512225 22673 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:55.512290 22673 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:55.512394 22673 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:58:55.517856 22673 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22673
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:55.518991 22673 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:55.520076 22673 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:58:55.530076 22673 server_base.cc:1034] running on GCE node
W20260808 05:58:55.530095 22679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:55.530047 22678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:55.530064 22681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:55.530817 22673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:55.531450 22673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:55.532619 22673 hybrid_clock.cc:648] HybridClock initialized: now 1786168735532606 us; error 28 us; skew 500 ppm
Aug 08 05:58:55 dist-test-slave-qg60 krb5kdc[22558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168735, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:55.535717 22673 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:58:55.536856 22673 webserver.cc:460] Webserver started at http://127.2.191.65:34705/ using document root <none> and password file <none>
I20260808 05:58:55.537439 22673 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:55.537535 22673 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:55.537771 22673 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:55.539867 22673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "c143cf0c1ac14167a67f0437e3dfc255"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "bc96daef947f317ddbfb3ad2bdcbf221"
server_key_iv: "6a51ead167ee25e7f5dc26a41ed57810"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.540462 22673 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "c143cf0c1ac14167a67f0437e3dfc255"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "bc96daef947f317ddbfb3ad2bdcbf221"
server_key_iv: "6a51ead167ee25e7f5dc26a41ed57810"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.544438 22673 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260808 05:58:55.546923 22688 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:55.548139 22673 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 05:58:55.548277 22673 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "c143cf0c1ac14167a67f0437e3dfc255"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "bc96daef947f317ddbfb3ad2bdcbf221"
server_key_iv: "6a51ead167ee25e7f5dc26a41ed57810"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.548393 22673 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:55.578142 22673 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:55.581629 22673 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:55.581847 22673 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:55.582470 22673 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:55.583312 22673 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:55.583385 22673 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:55.583458 22673 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:55.583511 22673 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:55.592553 22673 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:45471
I20260808 05:58:55.592592 22810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:45471 every 8 connection(s)
I20260808 05:58:55.593494 22673 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:58:55.599709 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 22673
I20260808 05:58:55.599869 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:58:55.600184 2813 external_mini_cluster.cc:1428] Setting key 96bcf0c5be551b57f1d110f897e1d80b
Aug 08 05:58:55 dist-test-slave-qg60 krb5kdc[22558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168735, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:55.608520 22648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:55.595321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:48129 (local address 127.2.191.126:44531)
0808 05:58:55.595462 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:55.595466 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:55.596281 (+ 815us) server_negotiation.cc:407] Connection header received
0808 05:58:55.597281 (+ 1000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:55.597285 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:55.597349 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:55.597454 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:55.598653 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.599204 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.600917 (+ 1713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.601162 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.601272 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:55.604178 (+ 2906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:55.604181 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:55.604183 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:55.604209 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:55.605761 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:55.606565 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:55.606569 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:55.606571 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:55.606731 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:55.607202 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:55.607208 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:55.607215 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:55.607435 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:55.607570 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:55.608160 (+ 590us) server_negotiation.cc:299] Negotiation successful
0808 05:58:55.608319 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:58:55.609515 22813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:55.595644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44531 (local address 127.2.191.65:48129)
0808 05:58:55.596122 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:55.596168 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:55.597045 (+ 877us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:55.597634 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:55.597641 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:55.597993 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:55.598470 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:55.598483 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.599346 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.599354 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:55.600715 (+ 1361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:55.600781 (+ 66us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.601325 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.601329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:55.601513 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:55.602163 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:55.602186 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:55.603963 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:55.605895 (+ 1932us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:55.605902 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:55.605919 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:55.606408 (+ 489us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:55.606884 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:55.606888 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:55.606890 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:55.607075 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:55.607570 (+ 495us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:55.607579 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:55.607864 (+ 285us) client_negotiation.cc:769] Sending connection context
0808 05:58:55.608113 (+ 249us) client_negotiation.cc:240] Negotiation successful
0808 05:58:55.608515 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":120,"threads_started":1}
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:58:55.610968 22811 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44531
I20260808 05:58:55.611245 22811 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:55.611766 22811 heartbeater.cc:511] Master 127.2.191.126:44531 requested a full tablet report, sending...
I20260808 05:58:55.613466 22606 ts_manager.cc:194] Registered new tserver with Master: c143cf0c1ac14167a67f0437e3dfc255 (127.2.191.65:45471)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:58:55.614864 22606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:48129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:58:55.632233 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44531
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:38307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:55.746555 22816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:55.746822 22816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:55.746865 22816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:55.750948 22816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:55.751010 22816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:55.751116 22816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:58:55.756565 22816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:55.757685 22816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:55.758701 22816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:55.768627 22821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:55.768632 22824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:55.768884 22816 server_base.cc:1034] running on GCE node
W20260808 05:58:55.768616 22822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:55.769477 22816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:55.770190 22816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:55.771413 22816 hybrid_clock.cc:648] HybridClock initialized: now 1786168735771397 us; error 29 us; skew 500 ppm
Aug 08 05:58:55 dist-test-slave-qg60 krb5kdc[22558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168735, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:55.774459 22816 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:58:55.775338 22816 webserver.cc:460] Webserver started at http://127.2.191.66:34877/ using document root <none> and password file <none>
I20260808 05:58:55.775904 22816 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:55.775966 22816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:55.776144 22816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:55.778623 22816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "a005f713992c4242b732cd818f90a624"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "3be376018de62f12253f1aaa71810f8b"
server_key_iv: "7bade6dfe8e19c7494fe0b515ebcf1a6"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.779194 22816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "a005f713992c4242b732cd818f90a624"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "3be376018de62f12253f1aaa71810f8b"
server_key_iv: "7bade6dfe8e19c7494fe0b515ebcf1a6"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.783238 22816 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 05:58:55.785892 22831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:55.787177 22816 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:55.787313 22816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "a005f713992c4242b732cd818f90a624"
format_stamp: "Formatted at 2026-08-08 05:58:55 on dist-test-slave-qg60"
server_key: "3be376018de62f12253f1aaa71810f8b"
server_key_iv: "7bade6dfe8e19c7494fe0b515ebcf1a6"
server_key_version: "encryptionkey@0"
I20260808 05:58:55.787431 22816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:55.810890 22816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:55.814402 22816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:55.814640 22816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:55.815299 22816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:55.816196 22816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:55.816256 22816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:55.816349 22816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:55.816370 22816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:55.826138 22816 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:39527
I20260808 05:58:55.826159 22951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:39527 every 8 connection(s)
I20260808 05:58:55.827075 22816 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:58:55.830439 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 22816
I20260808 05:58:55.830592 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:58:55.830926 2813 external_mini_cluster.cc:1428] Setting key 11c95c2ba7cc05380f1530805bab25a1
Aug 08 05:58:55 dist-test-slave-qg60 krb5kdc[22558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168735, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:58:55.841799 22648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:55.829076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:41809 (local address 127.2.191.126:44531)
0808 05:58:55.829229 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:55.829232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:55.830081 (+ 849us) server_negotiation.cc:407] Connection header received
0808 05:58:55.831186 (+ 1105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:55.831190 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:55.831253 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:55.831357 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:55.832848 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.833389 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.834827 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.835149 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.835272 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:55.838062 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:55.838065 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:55.838067 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:55.838091 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:55.839569 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:55.840113 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:55.840118 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:55.840123 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:55.840209 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:55.840567 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:55.840570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:55.840572 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:55.840847 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:55.840960 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:55.841472 (+ 512us) server_negotiation.cc:299] Negotiation successful
0808 05:58:55.841617 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:58:55.842650 22954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:55.829430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44531 (local address 127.2.191.66:41809)
0808 05:58:55.829914 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:55.829963 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:55.830923 (+ 960us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:55.831544 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:55.831553 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:55.831975 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:55.832636 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:55.832653 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.833521 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.833525 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:55.834695 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:55.834708 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:55.835313 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:55.835317 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:55.835488 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:55.836128 (+ 640us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:55.836153 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:55.837871 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:55.839714 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:55.839721 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:55.839736 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:55.840004 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:55.840309 (+ 305us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:55.840313 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:55.840315 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:55.840459 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:55.840958 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:55.840965 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:55.841227 (+ 262us) client_negotiation.cc:769] Sending connection context
0808 05:58:55.841425 (+ 198us) client_negotiation.cc:240] Negotiation successful
0808 05:58:55.841763 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":298,"thread_start_us":134,"threads_started":1}
I20260808 05:58:55.843914 22952 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44531
I20260808 05:58:55.844177 22952 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:55.844784 22952 heartbeater.cc:511] Master 127.2.191.126:44531 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:58:55.846019 22606 ts_manager.cc:194] Registered new tserver with Master: a005f713992c4242b732cd818f90a624 (127.2.191.66:39527)
I20260808 05:58:55.846618 22606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:41809
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:58:55.865154 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44531
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:38307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:55.983364 22957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:55.983611 22957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:55.983656 22957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:55.987972 22957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:55.988054 22957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:55.988150 22957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:58:55.993815 22957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:38307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:44531
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:55.994987 22957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:55.996047 22957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:56.006074 22965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:56.006111 22962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:56.006111 22963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:56.006742 22957 server_base.cc:1034] running on GCE node
I20260808 05:58:56.007124 22957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:56.007814 22957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:56.009025 22957 hybrid_clock.cc:648] HybridClock initialized: now 1786168736009011 us; error 34 us; skew 500 ppm
Aug 08 05:58:56 dist-test-slave-qg60 krb5kdc[22558](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168736, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:56.011956 22957 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:58:56.012977 22957 webserver.cc:460] Webserver started at http://127.2.191.67:36983/ using document root <none> and password file <none>
I20260808 05:58:56.013587 22957 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:56.013676 22957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:56.013861 22957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:56.015988 22957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "cdb1d8a50b6146e0a553438efb6c931c"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "effefaf6584634d65c28d84d42307b9e"
server_key_iv: "bd94b5b46d45ea2b4b435673bf492d47"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.016543 22957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "cdb1d8a50b6146e0a553438efb6c931c"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "effefaf6584634d65c28d84d42307b9e"
server_key_iv: "bd94b5b46d45ea2b4b435673bf492d47"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.020565 22957 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 05:58:56.023293 22973 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:56.024581 22957 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:58:56.024708 22957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "cdb1d8a50b6146e0a553438efb6c931c"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "effefaf6584634d65c28d84d42307b9e"
server_key_iv: "bd94b5b46d45ea2b4b435673bf492d47"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.024871 22957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:56.039969 22957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:56.043011 22957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:56.043170 22957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:56.043718 22957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:56.044548 22957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:56.044624 22957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:56.044690 22957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:56.044747 22957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260808 05:58:56.053931 22957 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:41721
I20260808 05:58:56.053957 23091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:41721 every 8 connection(s)
I20260808 05:58:56.054905 22957 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:58:56.063364 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 22957
I20260808 05:58:56.063568 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:58:56.063938 2813 external_mini_cluster.cc:1428] Setting key c5d4d0dc726c1efc7602f267681a51b4
Aug 08 05:58:56 dist-test-slave-qg60 krb5kdc[22558](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168736, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:56.069818 22648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.056852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:55979 (local address 127.2.191.126:44531)
0808 05:58:56.057008 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.057012 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.057928 (+ 916us) server_negotiation.cc:407] Connection header received
0808 05:58:56.058885 (+ 957us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.058889 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.058951 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.059061 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:56.060289 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.060967 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.062148 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.062373 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.062492 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.065857 (+ 3365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:56.065860 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:56.065862 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:56.065889 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:56.067520 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:56.068163 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:56.068166 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:56.068167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:56.068248 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:56.068575 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:56.068578 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:56.068579 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:56.068868 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:56.068973 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.069562 (+ 589us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.069688 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:58:56.070732 23094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.057246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:44531 (local address 127.2.191.67:55979)
0808 05:58:56.057775 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:56.057821 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:56.058679 (+ 858us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:56.059248 (+ 569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:56.059255 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:56.059623 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:56.060139 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.060153 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.061104 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.061108 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.061990 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.061999 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.062539 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.062544 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.062717 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.063678 (+ 961us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:56.063702 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:56.065681 (+ 1979us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:56.067647 (+ 1966us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:56.067653 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:56.067667 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:56.068064 (+ 397us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:56.068335 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:56.068337 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:56.068338 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:56.068492 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:56.069009 (+ 517us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:56.069015 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:56.069338 (+ 323us) client_negotiation.cc:769] Sending connection context
0808 05:58:56.069515 (+ 177us) client_negotiation.cc:240] Negotiation successful
0808 05:58:56.069804 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":133,"threads_started":1}
I20260808 05:58:56.071981 23092 heartbeater.cc:347] Connected to a master server at 127.2.191.126:44531
I20260808 05:58:56.072309 23092 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:56.072890 23092 heartbeater.cc:511] Master 127.2.191.126:44531 requested a full tablet report, sending...
I20260808 05:58:56.073953 22606 ts_manager.cc:194] Registered new tserver with Master: cdb1d8a50b6146e0a553438efb6c931c (127.2.191.67:41721)
I20260808 05:58:56.074559 22606 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:55979
I20260808 05:58:56.078636 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:58:56.089275 22648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.080709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35010 (local address 127.2.191.126:44531)
0808 05:58:56.080897 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.080902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.081145 (+ 243us) server_negotiation.cc:407] Connection header received
0808 05:58:56.081316 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.081325 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.081369 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.081453 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:56.082193 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.082733 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.083602 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.083837 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.083950 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.085751 (+ 1801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:56.085755 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:56.085758 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:56.085793 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:56.087278 (+ 1485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:56.087829 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:56.087837 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:56.087839 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:56.087919 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:56.088271 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:56.088275 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:56.088276 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:56.088498 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:56.088664 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.088994 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.089108 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 05:58:56.092892 22606 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35010:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:58:56.096060 22606 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:58:56.111014 23107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.104891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41721 (local address 127.0.0.1:35606)
0808 05:58:56.106088 (+ 1197us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:56.106103 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:56.106186 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:56.106753 (+ 567us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:56.106759 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:56.106781 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:56.106927 (+ 146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.106935 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.108067 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.108073 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.109399 (+ 1326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.109409 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.110398 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.110404 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.110523 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.110597 (+ 74us) client_negotiation.cc:769] Sending connection context
0808 05:58:56.110723 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 05:58:56.110849 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1108,"mutex_wait_us":1,"thread_start_us":98,"threads_started":1}
I20260808 05:58:56.111048 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.105558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35606 (local address 127.2.191.67:41721)
0808 05:58:56.106231 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.106243 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.106269 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:58:56.106353 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.106359 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.106593 (+ 234us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.106765 (+ 172us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:56.107068 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.107927 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.109528 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.110259 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.110372 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.110525 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.110778 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.110895 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":584,"thread_start_us":128,"threads_started":1}
I20260808 05:58:56.111917 23104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.104830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:45471 (local address 127.0.0.1:54382)
0808 05:58:56.105655 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:56.105713 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:56.105839 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:56.106920 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:56.106923 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:56.106941 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:56.107076 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.107083 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.108560 (+ 1477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.108567 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.109827 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.109838 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.111472 (+ 1634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.111475 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.111567 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.111591 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 05:58:56.111686 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 05:58:56.111776 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"mutex_wait_us":21,"spinlock_wait_cycles":4864,"thread_start_us":99,"threads_started":1}
I20260808 05:58:56.112135 23106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.104960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54382 (local address 127.2.191.65:45471)
0808 05:58:56.106447 (+ 1487us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.106466 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.106486 (+ 20us) server_negotiation.cc:407] Connection header received
0808 05:58:56.106563 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.106568 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.106757 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.107098 (+ 341us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:56.107227 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.108392 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.110463 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.111344 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.111445 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.111570 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.111736 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.111844 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1366,"thread_start_us":131,"threads_started":1}
I20260808 05:58:56.112294 23109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.105672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51836 (local address 127.2.191.66:39527)
0808 05:58:56.106222 (+ 550us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.106237 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.106486 (+ 249us) server_negotiation.cc:407] Connection header received
0808 05:58:56.106572 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.106577 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.106757 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.106908 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:56.107336 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.108489 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.109973 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.110787 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.110893 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.111023 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.112001 (+ 978us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.112133 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":139,"threads_started":1}
I20260808 05:58:56.112541 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.105163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:39527 (local address 127.0.0.1:51836)
0808 05:58:56.106370 (+ 1207us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:56.106384 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:56.106479 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:56.106938 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:56.106941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:56.106958 (+ 17us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:56.107221 (+ 263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.107226 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.108636 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.108639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.109827 (+ 1188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.109838 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.111620 (+ 1782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.111628 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.111753 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.111776 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 05:58:56.111852 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:58:56.111922 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1152,"mutex_wait_us":29,"thread_start_us":102,"threads_started":1}
I20260808 05:58:56.114348 23024 tablet_service.cc:1467] Processing CreateTablet for tablet 50c684ee6ce94868a2855c674be97292 (DEFAULT_TABLE table=test-table [id=22f27535133f4cb9aa74c8913cec578d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:56.114679 22740 tablet_service.cc:1467] Processing CreateTablet for tablet 50c684ee6ce94868a2855c674be97292 (DEFAULT_TABLE table=test-table [id=22f27535133f4cb9aa74c8913cec578d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:56.115589 23024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c684ee6ce94868a2855c674be97292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:56.115607 22740 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c684ee6ce94868a2855c674be97292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:56.115283 22882 tablet_service.cc:1467] Processing CreateTablet for tablet 50c684ee6ce94868a2855c674be97292 (DEFAULT_TABLE table=test-table [id=22f27535133f4cb9aa74c8913cec578d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:56.116289 22882 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50c684ee6ce94868a2855c674be97292. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:56.123660 23110 tablet_bootstrap.cc:492] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255: Bootstrap starting.
I20260808 05:58:56.125134 23112 tablet_bootstrap.cc:492] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Bootstrap starting.
I20260808 05:58:56.126046 23110 tablet_bootstrap.cc:654] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:56.126799 23110 log.cc:824] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:56.127496 23112 tablet_bootstrap.cc:654] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:56.128105 23111 tablet_bootstrap.cc:492] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Bootstrap starting.
I20260808 05:58:56.129189 23110 tablet_bootstrap.cc:492] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255: No bootstrap required, opened a new log
I20260808 05:58:56.129410 23110 ts_tablet_manager.cc:1397] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 05:58:56.129582 23112 log.cc:824] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:56.130746 23111 tablet_bootstrap.cc:654] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:56.131546 23111 log.cc:824] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:56.131794 23112 tablet_bootstrap.cc:492] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: No bootstrap required, opened a new log
I20260808 05:58:56.132004 23112 ts_tablet_manager.cc:1397] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 05:58:56.133785 23111 tablet_bootstrap.cc:492] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: No bootstrap required, opened a new log
I20260808 05:58:56.133687 23110 raft_consensus.cc:348] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.133955 23110 raft_consensus.cc:374] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:56.133993 23111 ts_tablet_manager.cc:1397] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260808 05:58:56.134009 23110 raft_consensus.cc:729] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c143cf0c1ac14167a67f0437e3dfc255, State: Initialized, Role: FOLLOWER
I20260808 05:58:56.134598 23110 consensus_queue.cc:260] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.135634 23110 ts_tablet_manager.cc:1428] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:58:56.136031 22811 heartbeater.cc:503] Master 127.2.191.126:44531 was elected leader, sending a full tablet report...
I20260808 05:58:56.136076 23112 raft_consensus.cc:348] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.136358 23112 raft_consensus.cc:374] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:56.136421 23112 raft_consensus.cc:729] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdb1d8a50b6146e0a553438efb6c931c, State: Initialized, Role: FOLLOWER
I20260808 05:58:56.136904 23112 consensus_queue.cc:260] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.137931 23112 ts_tablet_manager.cc:1428] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 05:58:56.138063 23111 raft_consensus.cc:348] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.138289 23092 heartbeater.cc:503] Master 127.2.191.126:44531 was elected leader, sending a full tablet report...
I20260808 05:58:56.138360 23111 raft_consensus.cc:374] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:56.138427 23111 raft_consensus.cc:729] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a005f713992c4242b732cd818f90a624, State: Initialized, Role: FOLLOWER
I20260808 05:58:56.138844 23111 consensus_queue.cc:260] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.139595 22952 heartbeater.cc:503] Master 127.2.191.126:44531 was elected leader, sending a full tablet report...
I20260808 05:58:56.139861 23111 ts_tablet_manager.cc:1428] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
W20260808 05:58:56.305946 23093 tablet.cc:2369] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:58:56.328243 22953 tablet.cc:2369] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:58:56.344898 22812 tablet.cc:2369] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:58:56.351118 23116 raft_consensus.cc:482] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:56.351323 23116 raft_consensus.cc:504] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.352491 23116 leader_election.cc:288] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdb1d8a50b6146e0a553438efb6c931c (127.2.191.67:41721), a005f713992c4242b732cd818f90a624 (127.2.191.66:39527)
I20260808 05:58:56.356695 23109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.352929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:33409 (local address 127.2.191.66:39527)
0808 05:58:56.353072 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.353078 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.353370 (+ 292us) server_negotiation.cc:407] Connection header received
0808 05:58:56.353603 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.353613 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.353660 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.353752 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:56.354111 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.354594 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.355710 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.356093 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.356193 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.356271 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.356470 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.356549 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:58:56.356745 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.352904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:44513 (local address 127.2.191.67:41721)
0808 05:58:56.353260 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.353267 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.353463 (+ 196us) server_negotiation.cc:407] Connection header received
0808 05:58:56.353618 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.353620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.353661 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.353750 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:56.354083 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.354600 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.355708 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.356129 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.356272 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.356326 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.356541 (+ 215us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.356623 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261}
I20260808 05:58:56.356743 23119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.352810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:39527 (local address 127.2.191.65:33409)
0808 05:58:56.353257 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:56.353272 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:56.353446 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:56.353766 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:56.353769 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:56.353785 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:56.353964 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.353970 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.354733 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.354736 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.355581 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.355590 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.356232 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.356236 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.356327 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.356357 (+ 30us) client_negotiation.cc:769] Sending connection context
0808 05:58:56.356431 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:58:56.356509 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":24,"thread_start_us":131,"threads_started":1}
I20260808 05:58:56.356750 23120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.352812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:41721 (local address 127.2.191.65:44513)
0808 05:58:56.353364 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:56.353376 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:56.353480 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:56.353760 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:56.353763 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:56.353777 (+ 14us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:56.353957 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.353963 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.354714 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.354718 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.355576 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.355585 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.356282 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.356288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.356387 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.356426 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 05:58:56.356508 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 05:58:56.356569 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"mutex_wait_us":72,"spinlock_wait_cycles":14080,"thread_start_us":135,"threads_started":1}
I20260808 05:58:56.357487 22905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c684ee6ce94868a2855c674be97292" candidate_uuid: "c143cf0c1ac14167a67f0437e3dfc255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005f713992c4242b732cd818f90a624" is_pre_election: true
I20260808 05:58:56.357493 23044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c684ee6ce94868a2855c674be97292" candidate_uuid: "c143cf0c1ac14167a67f0437e3dfc255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb1d8a50b6146e0a553438efb6c931c" is_pre_election: true
I20260808 05:58:56.357810 22905 raft_consensus.cc:2454] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c143cf0c1ac14167a67f0437e3dfc255 in term 0.
I20260808 05:58:56.357817 23044 raft_consensus.cc:2454] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c143cf0c1ac14167a67f0437e3dfc255 in term 0.
I20260808 05:58:56.358328 22691 leader_election.cc:302] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c143cf0c1ac14167a67f0437e3dfc255, cdb1d8a50b6146e0a553438efb6c931c; no voters:
I20260808 05:58:56.358633 23116 raft_consensus.cc:2781] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:58:56.358724 23116 raft_consensus.cc:482] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:58:56.358774 23116 raft_consensus.cc:3037] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:56.359853 23116 raft_consensus.cc:504] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.360253 23116 leader_election.cc:288] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [CANDIDATE]: Term 1 election: Requested vote from peers cdb1d8a50b6146e0a553438efb6c931c (127.2.191.67:41721), a005f713992c4242b732cd818f90a624 (127.2.191.66:39527)
I20260808 05:58:56.360661 22905 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c684ee6ce94868a2855c674be97292" candidate_uuid: "c143cf0c1ac14167a67f0437e3dfc255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a005f713992c4242b732cd818f90a624"
I20260808 05:58:56.360656 23044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50c684ee6ce94868a2855c674be97292" candidate_uuid: "c143cf0c1ac14167a67f0437e3dfc255" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdb1d8a50b6146e0a553438efb6c931c"
I20260808 05:58:56.360827 22905 raft_consensus.cc:3037] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:56.360827 23044 raft_consensus.cc:3037] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:56.361897 22905 raft_consensus.cc:2454] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c143cf0c1ac14167a67f0437e3dfc255 in term 1.
I20260808 05:58:56.361938 23044 raft_consensus.cc:2454] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c143cf0c1ac14167a67f0437e3dfc255 in term 1.
I20260808 05:58:56.362264 22693 leader_election.cc:302] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a005f713992c4242b732cd818f90a624, c143cf0c1ac14167a67f0437e3dfc255; no voters:
I20260808 05:58:56.362448 23116 raft_consensus.cc:2781] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:56.362656 23116 raft_consensus.cc:686] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 1 LEADER]: Becoming Leader. State: Replica: c143cf0c1ac14167a67f0437e3dfc255, State: Running, Role: LEADER
I20260808 05:58:56.363013 23116 consensus_queue.cc:237] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } }
I20260808 05:58:56.366305 22603 catalog_manager.cc:5495] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 reported cstate change: term changed from 0 to 1, leader changed from <none> to c143cf0c1ac14167a67f0437e3dfc255 (127.2.191.65). New cstate: current_term: 1 leader_uuid: "c143cf0c1ac14167a67f0437e3dfc255" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c143cf0c1ac14167a67f0437e3dfc255" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 45471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 } health_report { overall_health: UNKNOWN } } }
I20260808 05:58:56.405936 23106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.402150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54388 (local address 127.2.191.65:45471)
0808 05:58:56.402300 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.402303 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.402334 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:58:56.402405 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.402407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.402461 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.402565 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:58:56.402890 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.403391 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.404229 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.404437 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.404517 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.404911 (+ 394us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:58:56.405423 (+ 512us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:58:56.405558 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.405685 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.405761 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 05:58:56.412209 23044 raft_consensus.cc:1261] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 1 FOLLOWER]: Refusing update from remote peer c143cf0c1ac14167a67f0437e3dfc255: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:56.412206 22905 raft_consensus.cc:1261] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 1 FOLLOWER]: Refusing update from remote peer c143cf0c1ac14167a67f0437e3dfc255: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:56.413031 23121 consensus_queue.cc:1035] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdb1d8a50b6146e0a553438efb6c931c" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 41721 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:56.413223 23116 consensus_queue.cc:1035] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a005f713992c4242b732cd818f90a624" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 39527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:56.421304 23124 mvcc.cc:205] Tried to move back new op lower bound from 7316147144335929344 to 7316147144145563648. Current Snapshot: MvccSnapshot[applied={T|T < 7316147144335929344}]
I20260808 05:58:56.430246 22607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:56.430414 22607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35010:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:56.433074 22607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68e07860a2f64724b758c4e580acb302: Sending DeleteTablet for 3 replicas of tablet 50c684ee6ce94868a2855c674be97292
I20260808 05:58:56.433897 22740 tablet_service.cc:1514] Processing DeleteTablet for tablet 50c684ee6ce94868a2855c674be97292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:56 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:54382
I20260808 05:58:56.433905 23024 tablet_service.cc:1514] Processing DeleteTablet for tablet 50c684ee6ce94868a2855c674be97292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:56 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:35606
I20260808 05:58:56.434163 22882 tablet_service.cc:1514] Processing DeleteTablet for tablet 50c684ee6ce94868a2855c674be97292 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:56 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:51836
I20260808 05:58:56.434553 23138 tablet_replica.cc:330] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: stopping tablet replica
I20260808 05:58:56.434604 23137 tablet_replica.cc:330] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255: stopping tablet replica
I20260808 05:58:56.434909 23138 raft_consensus.cc:2229] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:58:56.435076 23137 raft_consensus.cc:2229] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:58:56.435276 23138 raft_consensus.cc:2258] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:56.435563 23137 raft_consensus.cc:2258] T 50c684ee6ce94868a2855c674be97292 P c143cf0c1ac14167a67f0437e3dfc255 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:56.435678 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 22673
I20260808 05:58:56.435679 23139 tablet_replica.cc:330] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: stopping tablet replica
I20260808 05:58:56.435990 23139 raft_consensus.cc:2229] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:58:56.436429 23139 raft_consensus.cc:2258] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:56.437075 23138 ts_tablet_manager.cc:1905] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:56.438201 23139 ts_tablet_manager.cc:1905] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:56.439692 23138 ts_tablet_manager.cc:1918] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:56.439818 23138 log.cc:1196] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/50c684ee6ce94868a2855c674be97292
I20260808 05:58:56.440150 23138 ts_tablet_manager.cc:1939] T 50c684ee6ce94868a2855c674be97292 P cdb1d8a50b6146e0a553438efb6c931c: Deleting consensus metadata
I20260808 05:58:56.441565 23139 ts_tablet_manager.cc:1918] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:56.441680 23139 log.cc:1196] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/50c684ee6ce94868a2855c674be97292
I20260808 05:58:56.441659 22591 catalog_manager.cc:4841] TS cdb1d8a50b6146e0a553438efb6c931c (127.2.191.67:41721): tablet 50c684ee6ce94868a2855c674be97292 (table test-table [id=22f27535133f4cb9aa74c8913cec578d]) successfully deleted
I20260808 05:58:56.441924 23139 ts_tablet_manager.cc:1939] T 50c684ee6ce94868a2855c674be97292 P a005f713992c4242b732cd818f90a624: Deleting consensus metadata
I20260808 05:58:56.443092 22592 catalog_manager.cc:4841] TS a005f713992c4242b732cd818f90a624 (127.2.191.66:39527): tablet 50c684ee6ce94868a2855c674be97292 (table test-table [id=22f27535133f4cb9aa74c8913cec578d]) successfully deleted
W20260808 05:58:56.447384 22590 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:45471 (error 108)
I20260808 05:58:56.447485 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 22816
I20260808 05:58:56.451578 23103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.451144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:45471 (local address 127.0.0.1:54392)
0808 05:58:56.451341 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:56.451443 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:45471: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260808 05:58:56.451815 22590 catalog_manager.cc:4584] TS c143cf0c1ac14167a67f0437e3dfc255 (127.2.191.65:45471): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 50c684ee6ce94868a2855c674be97292: Network error: Client connection negotiation failed: client connection to 127.2.191.65:45471: connect: Connection refused (error 111)
I20260808 05:58:56.456326 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 22957
I20260808 05:58:56.464259 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 22571
2026-08-08T05:58:56Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2590 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T05:58:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:58:56Z Disabled control of system clock
I20260808 05:58:56.499483 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:37467
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:33369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:37467
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:58:56.615094 23145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:56.615381 23145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:56.615417 23145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:56.619462 23145 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:58:56.619534 23145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:56.619549 23145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:56.619566 23145 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:58:56.619581 23145 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:58:56.624395 23145 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:37467
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:37467
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:56.625566 23145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:56.626924 23145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:56.636024 23150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:56.636000 23151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:56.635998 23153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:56.636404 23145 server_base.cc:1034] running on GCE node
I20260808 05:58:56.637097 23145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:56.638535 23145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:56.639727 23145 hybrid_clock.cc:648] HybridClock initialized: now 1786168736639698 us; error 39 us; skew 500 ppm
I20260808 05:58:56.647068 23145 webserver.cc:460] Webserver started at http://127.2.191.126:41117/ using document root <none> and password file <none>
I20260808 05:58:56.647753 23145 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:56.647825 23145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:56.648069 23145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:56.650390 23145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "7307dcbc31d64a41bc244e59eaef1b5f"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "a9a68907eaf5225b1d555d6bd7f41abf"
server_key_iv: "a6488d20401dfa7c91e8dda93d9619b2"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.651015 23145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "7307dcbc31d64a41bc244e59eaef1b5f"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "a9a68907eaf5225b1d555d6bd7f41abf"
server_key_iv: "a6488d20401dfa7c91e8dda93d9619b2"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.655165 23145 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:58:56.658231 23159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:56.659718 23145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:58:56.659893 23145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "7307dcbc31d64a41bc244e59eaef1b5f"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "a9a68907eaf5225b1d555d6bd7f41abf"
server_key_iv: "a6488d20401dfa7c91e8dda93d9619b2"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.660038 23145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:56.674005 23145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:56.674753 23145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:56.674968 23145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:56.682396 23145 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:37467
I20260808 05:58:56.682415 23215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:37467 every 8 connection(s)
I20260808 05:58:56.683386 23145 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:58:56.685956 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 23145
I20260808 05:58:56.686093 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:58:56.686445 2813 external_mini_cluster.cc:1428] Setting key 838ca32dc0df0871377f7741fdde3095
I20260808 05:58:56.687493 23216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:56.695163 23216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f: Bootstrap starting.
I20260808 05:58:56.697935 23219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.688114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38024 (local address 127.2.191.126:37467)
0808 05:58:56.688885 (+ 771us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.688907 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.688970 (+ 63us) server_negotiation.cc:407] Connection header received
0808 05:58:56.689877 (+ 907us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.689903 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.690427 (+ 524us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.690825 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:56.691283 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.692789 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.693797 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.694516 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.694701 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.695752 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:56.695758 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:56.695774 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:56.696270 (+ 496us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:56.696344 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:56.696376 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:56.696492 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.696670 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.696977 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310,"thread_start_us":149,"threads_started":1}
I20260808 05:58:56.698004 23216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:56.698896 23216 log.cc:824] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:56.701247 23216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f: No bootstrap required, opened a new log
I20260808 05:58:56.704972 23216 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7307dcbc31d64a41bc244e59eaef1b5f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37467 } }
I20260808 05:58:56.705224 23216 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:56.705271 23216 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7307dcbc31d64a41bc244e59eaef1b5f, State: Initialized, Role: FOLLOWER
I20260808 05:58:56.705641 23216 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7307dcbc31d64a41bc244e59eaef1b5f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37467 } }
I20260808 05:58:56.705761 23216 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:58:56.705802 23216 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:58:56.705873 23216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:56.706795 23216 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7307dcbc31d64a41bc244e59eaef1b5f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37467 } }
I20260808 05:58:56.707183 23216 leader_election.cc:302] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7307dcbc31d64a41bc244e59eaef1b5f; no voters:
I20260808 05:58:56.707576 23216 leader_election.cc:288] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:58:56.707679 23221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:56.707950 23221 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [term 1 LEADER]: Becoming Leader. State: Replica: 7307dcbc31d64a41bc244e59eaef1b5f, State: Running, Role: LEADER
I20260808 05:58:56.708279 23221 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7307dcbc31d64a41bc244e59eaef1b5f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37467 } }
I20260808 05:58:56.708974 23216 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:58:56.710131 23223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7307dcbc31d64a41bc244e59eaef1b5f. Latest consensus state: current_term: 1 leader_uuid: "7307dcbc31d64a41bc244e59eaef1b5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7307dcbc31d64a41bc244e59eaef1b5f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37467 } } }
I20260808 05:58:56.710121 23222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7307dcbc31d64a41bc244e59eaef1b5f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7307dcbc31d64a41bc244e59eaef1b5f" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37467 } } }
I20260808 05:58:56.710279 23223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:56.710372 23222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:56.710729 23230 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:58:56.714102 23230 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:58:56.721177 23230 catalog_manager.cc:1347] Generated new cluster ID: e12dd0364253493fb2c87b9d5e9ebf91
I20260808 05:58:56.721272 23230 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:58:56.741191 23230 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:58:56.742482 23230 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:58:56.749333 23230 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f: Generated new TSK 0
I20260808 05:58:56.750231 23230 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:58:56.753695 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:37467
--builtin_ntp_servers=127.2.191.84:33369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:58:56.881356 23242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:56.881636 23242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:56.881677 23242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:56.885821 23242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:56.885895 23242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:56.885987 23242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:58:56.891008 23242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:37467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:56.892207 23242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:56.893762 23242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:56.904268 23248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:56.904315 23247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:56.904306 23250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:56.904596 23242 server_base.cc:1034] running on GCE node
I20260808 05:58:56.905059 23242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:56.905793 23242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:56.906985 23242 hybrid_clock.cc:648] HybridClock initialized: now 1786168736906953 us; error 41 us; skew 500 ppm
I20260808 05:58:56.909271 23242 webserver.cc:460] Webserver started at http://127.2.191.65:37511/ using document root <none> and password file <none>
I20260808 05:58:56.909953 23242 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:56.910028 23242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:56.910280 23242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:56.912658 23242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "3263eeebd4e0430eae5159b4615f5b4e"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "1be3a8ceb6f5a691059f612e93deaaba"
server_key_iv: "ecb7009ad029f95521e4329ca9166ebf"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.913307 23242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "3263eeebd4e0430eae5159b4615f5b4e"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "1be3a8ceb6f5a691059f612e93deaaba"
server_key_iv: "ecb7009ad029f95521e4329ca9166ebf"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.917438 23242 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:58:56.920135 23256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:56.921655 23242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:56.921789 23242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "3263eeebd4e0430eae5159b4615f5b4e"
format_stamp: "Formatted at 2026-08-08 05:58:56 on dist-test-slave-qg60"
server_key: "1be3a8ceb6f5a691059f612e93deaaba"
server_key_iv: "ecb7009ad029f95521e4329ca9166ebf"
server_key_version: "encryptionkey@0"
I20260808 05:58:56.921896 23242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:56.947454 23242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:56.948151 23242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:56.948311 23242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:56.948884 23242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:56.949851 23242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:56.949898 23242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:56.949939 23242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:56.949954 23242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:56.959365 23242 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:33865
I20260808 05:58:56.959398 23374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:33865 every 8 connection(s)
I20260808 05:58:56.960325 23242 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:58:56.962549 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 23242
I20260808 05:58:56.962699 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:58:56.963004 2813 external_mini_cluster.cc:1428] Setting key 31c982e49cdf8cbb2fb54b04b9f48090
I20260808 05:58:56.965204 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:37467
--builtin_ntp_servers=127.2.191.84:33369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:58:56.970468 23219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.962257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:53817 (local address 127.2.191.126:37467)
0808 05:58:56.962427 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:56.962432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:56.963722 (+ 1290us) server_negotiation.cc:407] Connection header received
0808 05:58:56.965470 (+ 1748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:56.965474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:56.965536 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:56.965643 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:56.966560 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.967113 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.968281 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.968514 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.968630 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.969933 (+ 1303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:56.969937 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:56.969940 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:56.969962 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:56.969981 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:56.969989 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:56.970073 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:56.970243 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 05:58:56.970315 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:58:56.971371 23377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:56.962676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:37467 (local address 127.2.191.65:53817)
0808 05:58:56.963488 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:56.963607 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:56.965234 (+ 1627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:56.965829 (+ 595us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:56.965837 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:56.965923 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:56.966417 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.966429 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.967252 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.967256 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.968145 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:56.968154 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:56.968682 (+ 528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:56.968687 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:56.968893 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:56.969657 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:58:56.969659 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:56.969700 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:58:56.969766 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:56.970075 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:56.970088 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:56.970102 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:58:56.970243 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 05:58:56.970537 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":136,"threads_started":1}
I20260808 05:58:56.972752 23375 heartbeater.cc:347] Connected to a master server at 127.2.191.126:37467
I20260808 05:58:56.973052 23375 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:56.973768 23375 heartbeater.cc:511] Master 127.2.191.126:37467 requested a full tablet report, sending...
I20260808 05:58:56.975484 23177 ts_manager.cc:194] Registered new tserver with Master: 3263eeebd4e0430eae5159b4615f5b4e (127.2.191.65:33865)
I20260808 05:58:56.976694 23177 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.65:53817
W20260808 05:58:57.084038 23378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:57.084331 23378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:57.084373 23378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:57.088627 23378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:57.088697 23378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:57.088826 23378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:58:57.093767 23378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:37467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:57.094897 23378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:57.096342 23378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:57.106320 23383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:57.106314 23384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:57.106335 23386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:57.106707 23378 server_base.cc:1034] running on GCE node
I20260808 05:58:57.107151 23378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:57.107805 23378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:57.108971 23378 hybrid_clock.cc:648] HybridClock initialized: now 1786168737108955 us; error 29 us; skew 500 ppm
I20260808 05:58:57.111222 23378 webserver.cc:460] Webserver started at http://127.2.191.66:39021/ using document root <none> and password file <none>
I20260808 05:58:57.111843 23378 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:57.111908 23378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:57.112176 23378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:57.114382 23378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "9aa3e838a0644e1d8fd80e205a706a7f"
format_stamp: "Formatted at 2026-08-08 05:58:57 on dist-test-slave-qg60"
server_key: "2cc51f03ede33253e3f65640b46072b4"
server_key_iv: "88a45b9d23442de3c3d6a627c6147f20"
server_key_version: "encryptionkey@0"
I20260808 05:58:57.114960 23378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "9aa3e838a0644e1d8fd80e205a706a7f"
format_stamp: "Formatted at 2026-08-08 05:58:57 on dist-test-slave-qg60"
server_key: "2cc51f03ede33253e3f65640b46072b4"
server_key_iv: "88a45b9d23442de3c3d6a627c6147f20"
server_key_version: "encryptionkey@0"
I20260808 05:58:57.118877 23378 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.002s
I20260808 05:58:57.122211 23392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:57.123826 23378 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260808 05:58:57.123967 23378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "9aa3e838a0644e1d8fd80e205a706a7f"
format_stamp: "Formatted at 2026-08-08 05:58:57 on dist-test-slave-qg60"
server_key: "2cc51f03ede33253e3f65640b46072b4"
server_key_iv: "88a45b9d23442de3c3d6a627c6147f20"
server_key_version: "encryptionkey@0"
I20260808 05:58:57.124097 23378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:57.166010 23378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:57.166842 23378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:57.167073 23378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:57.167748 23378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:57.168864 23378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:57.168932 23378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:57.169006 23378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:57.169045 23378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:57.178793 23378 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:36543
I20260808 05:58:57.178818 23510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:36543 every 8 connection(s)
I20260808 05:58:57.179836 23378 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:58:57.183310 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 23378
I20260808 05:58:57.183463 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:58:57.183871 2813 external_mini_cluster.cc:1428] Setting key 06ef3529c7c91879c9dc7c6a9e4a589e
I20260808 05:58:57.186057 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:37467
--builtin_ntp_servers=127.2.191.84:33369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:58:57.190510 23219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.181873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:47163 (local address 127.2.191.126:37467)
0808 05:58:57.182042 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.182046 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.183214 (+ 1168us) server_negotiation.cc:407] Connection header received
0808 05:58:57.185226 (+ 2012us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.185230 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.185288 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.185377 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:57.186416 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.187002 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.188278 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.188529 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.188655 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.189990 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:57.189996 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:57.190003 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:57.190016 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:57.190036 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:57.190044 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:57.190131 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.190298 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.190363 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 05:58:57.191461 23513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.182277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:37467 (local address 127.2.191.66:47163)
0808 05:58:57.183015 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:57.183078 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:57.184991 (+ 1913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:57.185555 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:57.185564 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:57.185660 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:57.186245 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.186268 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.187143 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.187147 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.188130 (+ 983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.188140 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.188703 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.188707 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.188939 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.189687 (+ 748us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:58:57.189689 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:57.189732 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:58:57.189801 (+ 69us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:57.190137 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:57.190149 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:57.190155 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:58:57.190298 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 05:58:57.190600 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":289,"thread_start_us":123,"threads_started":1}
I20260808 05:58:57.192669 23511 heartbeater.cc:347] Connected to a master server at 127.2.191.126:37467
I20260808 05:58:57.192937 23511 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:57.193477 23511 heartbeater.cc:511] Master 127.2.191.126:37467 requested a full tablet report, sending...
I20260808 05:58:57.194628 23177 ts_manager.cc:194] Registered new tserver with Master: 9aa3e838a0644e1d8fd80e205a706a7f (127.2.191.66:36543)
I20260808 05:58:57.195509 23177 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.66:47163
W20260808 05:58:57.304883 23514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:57.305182 23514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:57.305222 23514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:57.309353 23514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:57.309412 23514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:57.309466 23514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:58:57.314509 23514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:37467
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:57.315594 23514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:57.317075 23514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:57.327131 23519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:57.327179 23520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:57.327181 23514 server_base.cc:1034] running on GCE node
W20260808 05:58:57.327126 23523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:57.327764 23514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:57.328552 23514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:57.329752 23514 hybrid_clock.cc:648] HybridClock initialized: now 1786168737329710 us; error 64 us; skew 500 ppm
I20260808 05:58:57.331638 23514 webserver.cc:460] Webserver started at http://127.2.191.67:33241/ using document root <none> and password file <none>
I20260808 05:58:57.332239 23514 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:57.332305 23514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:57.332527 23514 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:57.334745 23514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "7d2bffc7bd9f43ce8907190fc809c5c1"
format_stamp: "Formatted at 2026-08-08 05:58:57 on dist-test-slave-qg60"
server_key: "39fe5720dbe38a43a2e5424da720aa15"
server_key_iv: "83bd4ffdf413b9bbc08b4748687b8d24"
server_key_version: "encryptionkey@0"
I20260808 05:58:57.335471 23514 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "7d2bffc7bd9f43ce8907190fc809c5c1"
format_stamp: "Formatted at 2026-08-08 05:58:57 on dist-test-slave-qg60"
server_key: "39fe5720dbe38a43a2e5424da720aa15"
server_key_iv: "83bd4ffdf413b9bbc08b4748687b8d24"
server_key_version: "encryptionkey@0"
I20260808 05:58:57.339541 23514 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20260808 05:58:57.342088 23529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:57.343376 23514 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:58:57.343523 23514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "7d2bffc7bd9f43ce8907190fc809c5c1"
format_stamp: "Formatted at 2026-08-08 05:58:57 on dist-test-slave-qg60"
server_key: "39fe5720dbe38a43a2e5424da720aa15"
server_key_iv: "83bd4ffdf413b9bbc08b4748687b8d24"
server_key_version: "encryptionkey@0"
I20260808 05:58:57.343660 23514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:57.358830 23514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:57.359558 23514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:57.359776 23514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:57.360390 23514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:57.361404 23514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:57.361452 23514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:57.361514 23514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:57.361549 23514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:57.370617 23514 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:35359
I20260808 05:58:57.370642 23648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:35359 every 8 connection(s)
I20260808 05:58:57.371587 23514 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:58:57.373862 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 23514
I20260808 05:58:57.373984 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:58:57.374349 2813 external_mini_cluster.cc:1428] Setting key 13d47d0af1c9a06988cf68678d0a803f
I20260808 05:58:57.381628 23219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.373477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:41201 (local address 127.2.191.126:37467)
0808 05:58:57.373628 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.373632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.375126 (+ 1494us) server_negotiation.cc:407] Connection header received
0808 05:58:57.376838 (+ 1712us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.376842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.376906 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.377017 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:57.377929 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.378473 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.379644 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.379868 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.380003 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.381124 (+ 1121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:57.381128 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:57.381130 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:57.381143 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:57.381171 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:57.381178 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:57.381258 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.381416 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.381480 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:58:57.382529 23651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.374024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:37467 (local address 127.2.191.67:41201)
0808 05:58:57.374964 (+ 940us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:57.375019 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:57.376585 (+ 1566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:57.377191 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:57.377198 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:57.377284 (+ 86us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:57.377782 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.377794 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.378610 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.378614 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.379513 (+ 899us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.379522 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.380058 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.380062 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.380222 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.380865 (+ 643us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:58:57.380867 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:57.380907 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:58:57.380973 (+ 66us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:57.381259 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:57.381271 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:57.381280 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 05:58:57.381415 (+ 135us) client_negotiation.cc:240] Negotiation successful
0808 05:58:57.381761 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":161,"threads_started":1}
I20260808 05:58:57.383693 23649 heartbeater.cc:347] Connected to a master server at 127.2.191.126:37467
I20260808 05:58:57.383934 23649 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:57.384469 23649 heartbeater.cc:511] Master 127.2.191.126:37467 requested a full tablet report, sending...
I20260808 05:58:57.385569 23177 ts_manager.cc:194] Registered new tserver with Master: 7d2bffc7bd9f43ce8907190fc809c5c1 (127.2.191.67:35359)
I20260808 05:58:57.386144 23177 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.67:41201
I20260808 05:58:57.388347 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:58:57.394197 23219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.390409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38026 (local address 127.2.191.126:37467)
0808 05:58:57.390573 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.390579 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.390722 (+ 143us) server_negotiation.cc:407] Connection header received
0808 05:58:57.390827 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.390830 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.390870 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.390938 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:57.391155 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.391664 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.392512 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.392793 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.392879 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.393746 (+ 867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:57.393749 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:57.393751 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:58:57.393761 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:57.393779 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:58:57.393785 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:57.393876 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.393981 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.394038 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260808 05:58:57.397361 23177 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38026:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:58:57.400398 23177 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:58:57.414728 23663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.408558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42972 (local address 127.2.191.65:33865)
0808 05:58:57.409063 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.409077 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.409476 (+ 399us) server_negotiation.cc:407] Connection header received
0808 05:58:57.409742 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.409748 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.409970 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.410134 (+ 164us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:57.410707 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.412022 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.413394 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.413937 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.414068 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.414294 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.414427 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.414534 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":120,"threads_started":1}
I20260808 05:58:57.414741 23665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.408401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33865 (local address 127.0.0.1:42972)
0808 05:58:57.409327 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:57.409382 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:57.409535 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:57.410363 (+ 828us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:57.410395 (+ 32us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:57.410422 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:57.410574 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.410581 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.412148 (+ 1567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.412152 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.413263 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.413271 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.414072 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.414075 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.414241 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.414288 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 05:58:57.414398 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 05:58:57.414573 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":758,"mutex_wait_us":52,"thread_start_us":107,"threads_started":1}
I20260808 05:58:57.414762 23662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.408765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:35359 (local address 127.0.0.1:44950)
0808 05:58:57.409327 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:57.409382 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:57.409515 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:57.410466 (+ 951us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:57.410469 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:57.410488 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:57.410587 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.410593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.411795 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.411800 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.413130 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.413140 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.414243 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.414247 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.414340 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.414364 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 05:58:57.414412 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:58:57.414561 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":3,"spinlock_wait_cycles":18176,"thread_start_us":87,"threads_started":1}
I20260808 05:58:57.415701 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.408914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44950 (local address 127.2.191.67:35359)
0808 05:58:57.410046 (+ 1132us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.410067 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.410086 (+ 19us) server_negotiation.cc:407] Connection header received
0808 05:58:57.410150 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.410154 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.410297 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.410737 (+ 440us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:57.410905 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.411681 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.413280 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.414090 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.415123 (+ 1033us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.415322 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.415377 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.415475 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":995,"thread_start_us":99,"threads_started":1}
I20260808 05:58:57.416153 23667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.409204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57818 (local address 127.2.191.66:36543)
0808 05:58:57.409536 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.409549 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.410021 (+ 472us) server_negotiation.cc:407] Connection header received
0808 05:58:57.410113 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.410119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.410297 (+ 178us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.410509 (+ 212us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:57.410877 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.412030 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.414677 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.415491 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.415625 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.415817 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.415871 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.415960 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":144,"threads_started":1}
I20260808 05:58:57.416682 23668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.408408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:36543 (local address 127.0.0.1:57818)
0808 05:58:57.409810 (+ 1402us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:57.409825 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:57.409920 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:57.410655 (+ 735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:57.410661 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:57.410681 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:57.410751 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.410756 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.413374 (+ 2618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.413377 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.414539 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.414549 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.415636 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.415639 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.415725 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.415749 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 05:58:57.415813 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:58:57.416541 (+ 728us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1327,"mutex_wait_us":1178,"thread_start_us":104,"threads_started":1}
I20260808 05:58:57.418735 23308 tablet_service.cc:1467] Processing CreateTablet for tablet eea382f54c10428b934f69458c611980 (DEFAULT_TABLE table=test-table [id=53167f621b7642e489f53335539ccdb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:57.418735 23579 tablet_service.cc:1467] Processing CreateTablet for tablet eea382f54c10428b934f69458c611980 (DEFAULT_TABLE table=test-table [id=53167f621b7642e489f53335539ccdb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:57.418924 23442 tablet_service.cc:1467] Processing CreateTablet for tablet eea382f54c10428b934f69458c611980 (DEFAULT_TABLE table=test-table [id=53167f621b7642e489f53335539ccdb5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:57.419906 23579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea382f54c10428b934f69458c611980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:57.419906 23308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea382f54c10428b934f69458c611980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:57.419929 23442 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eea382f54c10428b934f69458c611980. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:57.426337 23669 tablet_bootstrap.cc:492] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: Bootstrap starting.
I20260808 05:58:57.427814 23670 tablet_bootstrap.cc:492] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e: Bootstrap starting.
I20260808 05:58:57.427927 23671 tablet_bootstrap.cc:492] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: Bootstrap starting.
I20260808 05:58:57.428996 23669 tablet_bootstrap.cc:654] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:57.429754 23669 log.cc:824] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:57.430181 23670 tablet_bootstrap.cc:654] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:57.430181 23671 tablet_bootstrap.cc:654] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:57.431034 23671 log.cc:824] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:57.431046 23670 log.cc:824] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:57.432374 23669 tablet_bootstrap.cc:492] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: No bootstrap required, opened a new log
I20260808 05:58:57.432606 23669 ts_tablet_manager.cc:1397] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:58:57.433169 23671 tablet_bootstrap.cc:492] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: No bootstrap required, opened a new log
I20260808 05:58:57.433192 23670 tablet_bootstrap.cc:492] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e: No bootstrap required, opened a new log
I20260808 05:58:57.433373 23671 ts_tablet_manager.cc:1397] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260808 05:58:57.433373 23670 ts_tablet_manager.cc:1397] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s
I20260808 05:58:57.436156 23669 raft_consensus.cc:348] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.436427 23669 raft_consensus.cc:374] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:57.436501 23669 raft_consensus.cc:729] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9aa3e838a0644e1d8fd80e205a706a7f, State: Initialized, Role: FOLLOWER
I20260808 05:58:57.437047 23669 consensus_queue.cc:260] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.437829 23671 raft_consensus.cc:348] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.437827 23670 raft_consensus.cc:348] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.438098 23671 raft_consensus.cc:374] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:57.438107 23670 raft_consensus.cc:374] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:57.438175 23671 raft_consensus.cc:729] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d2bffc7bd9f43ce8907190fc809c5c1, State: Initialized, Role: FOLLOWER
I20260808 05:58:57.438175 23670 raft_consensus.cc:729] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3263eeebd4e0430eae5159b4615f5b4e, State: Initialized, Role: FOLLOWER
I20260808 05:58:57.438594 23669 ts_tablet_manager.cc:1428] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: Time spent starting tablet: real 0.006s user 0.003s sys 0.004s
I20260808 05:58:57.438663 23671 consensus_queue.cc:260] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.438663 23670 consensus_queue.cc:260] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.439013 23511 heartbeater.cc:503] Master 127.2.191.126:37467 was elected leader, sending a full tablet report...
I20260808 05:58:57.439664 23649 heartbeater.cc:503] Master 127.2.191.126:37467 was elected leader, sending a full tablet report...
I20260808 05:58:57.439708 23670 ts_tablet_manager.cc:1428] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:58:57.439812 23375 heartbeater.cc:503] Master 127.2.191.126:37467 was elected leader, sending a full tablet report...
I20260808 05:58:57.441015 23671 ts_tablet_manager.cc:1428] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
W20260808 05:58:57.461544 23376 tablet.cc:2369] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:58:57.524989 23677 raft_consensus.cc:482] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:58:57.525202 23677 raft_consensus.cc:504] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.526438 23677 leader_election.cc:288] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3263eeebd4e0430eae5159b4615f5b4e (127.2.191.65:33865), 9aa3e838a0644e1d8fd80e205a706a7f (127.2.191.66:36543)
I20260808 05:58:57.531059 23651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.526752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:36543 (local address 127.2.191.67:48803)
0808 05:58:57.526919 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:57.526950 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:57.527066 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:57.527434 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:57.527438 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:57.527468 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:57.527629 (+ 161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.527638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.528695 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.528699 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.529727 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.529737 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.530574 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.530580 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.530689 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.530748 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 05:58:57.530823 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:58:57.530884 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":83}
I20260808 05:58:57.531095 23667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.526904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:48803 (local address 127.2.191.66:36543)
0808 05:58:57.527033 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.527037 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.527052 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:58:57.527219 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.527222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.527292 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.527382 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:57.527764 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.528530 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.529857 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.530438 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.530566 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.530638 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.530870 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.530966 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:58:57.531116 23678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.526752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33865 (local address 127.2.191.67:44227)
0808 05:58:57.527317 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:57.527333 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:57.527447 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:57.527736 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:57.527742 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:57.527760 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:57.527879 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.527885 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.528619 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.528626 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.529765 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:57.529775 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.530685 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.530688 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:57.530816 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.530847 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 05:58:57.530922 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:58:57.530984 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":99,"thread_start_us":177,"threads_started":1}
I20260808 05:58:57.531159 23663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.526993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:44227 (local address 127.2.191.65:33865)
0808 05:58:57.527125 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.527130 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.527424 (+ 294us) server_negotiation.cc:407] Connection header received
0808 05:58:57.527558 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.527562 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.527618 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.527714 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:57.527992 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.528505 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.529950 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.530559 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.530683 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.530743 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.530955 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.531031 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:58:57.531948 23329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea382f54c10428b934f69458c611980" candidate_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3263eeebd4e0430eae5159b4615f5b4e" is_pre_election: true
I20260808 05:58:57.531956 23464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea382f54c10428b934f69458c611980" candidate_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" is_pre_election: true
I20260808 05:58:57.532272 23464 raft_consensus.cc:2454] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bffc7bd9f43ce8907190fc809c5c1 in term 0.
I20260808 05:58:57.532274 23329 raft_consensus.cc:2454] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d2bffc7bd9f43ce8907190fc809c5c1 in term 0.
I20260808 05:58:57.532827 23530 leader_election.cc:302] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3263eeebd4e0430eae5159b4615f5b4e, 7d2bffc7bd9f43ce8907190fc809c5c1, 9aa3e838a0644e1d8fd80e205a706a7f; no voters:
I20260808 05:58:57.533130 23677 raft_consensus.cc:2781] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:58:57.533211 23677 raft_consensus.cc:482] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:58:57.533243 23677 raft_consensus.cc:3037] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:57.534292 23677 raft_consensus.cc:504] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.534694 23677 leader_election.cc:288] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [CANDIDATE]: Term 1 election: Requested vote from peers 3263eeebd4e0430eae5159b4615f5b4e (127.2.191.65:33865), 9aa3e838a0644e1d8fd80e205a706a7f (127.2.191.66:36543)
I20260808 05:58:57.535007 23329 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea382f54c10428b934f69458c611980" candidate_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3263eeebd4e0430eae5159b4615f5b4e"
I20260808 05:58:57.535149 23329 raft_consensus.cc:3037] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:57.535120 23464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eea382f54c10428b934f69458c611980" candidate_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9aa3e838a0644e1d8fd80e205a706a7f"
I20260808 05:58:57.535310 23464 raft_consensus.cc:3037] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:57.536279 23329 raft_consensus.cc:2454] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bffc7bd9f43ce8907190fc809c5c1 in term 1.
I20260808 05:58:57.536526 23464 raft_consensus.cc:2454] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d2bffc7bd9f43ce8907190fc809c5c1 in term 1.
I20260808 05:58:57.536641 23531 leader_election.cc:302] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3263eeebd4e0430eae5159b4615f5b4e, 7d2bffc7bd9f43ce8907190fc809c5c1; no voters:
I20260808 05:58:57.536844 23677 raft_consensus.cc:2781] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:57.537083 23677 raft_consensus.cc:686] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 1 LEADER]: Becoming Leader. State: Replica: 7d2bffc7bd9f43ce8907190fc809c5c1, State: Running, Role: LEADER
I20260808 05:58:57.537475 23677 consensus_queue.cc:237] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } }
I20260808 05:58:57.540954 23175 catalog_manager.cc:5495] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d2bffc7bd9f43ce8907190fc809c5c1 (127.2.191.67). New cstate: current_term: 1 leader_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d2bffc7bd9f43ce8907190fc809c5c1" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 35359 } health_report { overall_health: HEALTHY } } }
I20260808 05:58:57.569738 23666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.565911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44952 (local address 127.2.191.67:35359)
0808 05:58:57.566119 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:57.566122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:57.566135 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:58:57.566204 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:57.566206 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:57.566261 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:57.566380 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:58:57.566660 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.567162 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.568062 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:57.568276 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:57.568384 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:57.568779 (+ 395us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:58:57.569231 (+ 452us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:58:57.569397 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:57.569531 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 05:58:57.569566 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260808 05:58:57.575935 23329 raft_consensus.cc:1261] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 1 FOLLOWER]: Refusing update from remote peer 7d2bffc7bd9f43ce8907190fc809c5c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:57.575935 23464 raft_consensus.cc:1261] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 1 FOLLOWER]: Refusing update from remote peer 7d2bffc7bd9f43ce8907190fc809c5c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:58:57.576807 23679 consensus_queue.cc:1035] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9aa3e838a0644e1d8fd80e205a706a7f" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 36543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:57.577014 23677 consensus_queue.cc:1035] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3263eeebd4e0430eae5159b4615f5b4e" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 33865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:58:57.595059 23176 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:57.595265 23176 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38026:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:58:57.597970 23176 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7307dcbc31d64a41bc244e59eaef1b5f: Sending DeleteTablet for 3 replicas of tablet eea382f54c10428b934f69458c611980
I20260808 05:58:57.598790 23442 tablet_service.cc:1514] Processing DeleteTablet for tablet eea382f54c10428b934f69458c611980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:57 UTC) from {username='slave'} at 127.0.0.1:57818
I20260808 05:58:57.598788 23579 tablet_service.cc:1514] Processing DeleteTablet for tablet eea382f54c10428b934f69458c611980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:57 UTC) from {username='slave'} at 127.0.0.1:44950
I20260808 05:58:57.598809 23308 tablet_service.cc:1514] Processing DeleteTablet for tablet eea382f54c10428b934f69458c611980 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:58:57 UTC) from {username='slave'} at 127.0.0.1:42972
I20260808 05:58:57.599349 23695 tablet_replica.cc:330] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e: stopping tablet replica
I20260808 05:58:57.599694 23695 raft_consensus.cc:2229] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:58:57.600047 23695 raft_consensus.cc:2258] T eea382f54c10428b934f69458c611980 P 3263eeebd4e0430eae5159b4615f5b4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:57.600204 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 23242
I20260808 05:58:57.600454 23693 tablet_replica.cc:330] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: stopping tablet replica
I20260808 05:58:57.600963 23694 tablet_replica.cc:330] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: stopping tablet replica
I20260808 05:58:57.601233 23694 raft_consensus.cc:2229] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:58:57.601574 23694 raft_consensus.cc:2258] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:57.601830 23693 raft_consensus.cc:2229] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:58:57.602161 23693 raft_consensus.cc:2258] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:58:57.603910 23694 ts_tablet_manager.cc:1905] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:57.606798 23694 ts_tablet_manager.cc:1918] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:57.606909 23694 log.cc:1196] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/eea382f54c10428b934f69458c611980
I20260808 05:58:57.607251 23694 ts_tablet_manager.cc:1939] T eea382f54c10428b934f69458c611980 P 7d2bffc7bd9f43ce8907190fc809c5c1: Deleting consensus metadata
I20260808 05:58:57.608579 23164 catalog_manager.cc:4841] TS 7d2bffc7bd9f43ce8907190fc809c5c1 (127.2.191.67:35359): tablet eea382f54c10428b934f69458c611980 (table test-table [id=53167f621b7642e489f53335539ccdb5]) successfully deleted
I20260808 05:58:57.610203 23693 ts_tablet_manager.cc:1905] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:58:57.612996 23693 ts_tablet_manager.cc:1918] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:58:57.613107 23693 log.cc:1196] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/eea382f54c10428b934f69458c611980
I20260808 05:58:57.613528 23693 ts_tablet_manager.cc:1939] T eea382f54c10428b934f69458c611980 P 9aa3e838a0644e1d8fd80e205a706a7f: Deleting consensus metadata
I20260808 05:58:57.614889 23161 catalog_manager.cc:4841] TS 9aa3e838a0644e1d8fd80e205a706a7f (127.2.191.66:36543): tablet eea382f54c10428b934f69458c611980 (table test-table [id=53167f621b7642e489f53335539ccdb5]) successfully deleted
W20260808 05:58:57.622982 23162 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:33865 (error 108)
I20260808 05:58:57.623116 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 23378
I20260808 05:58:57.626428 23668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:57.626031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:33865 (local address 127.0.0.1:42986)
0808 05:58:57.626217 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:57.626311 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:33865: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260808 05:58:57.626729 23162 catalog_manager.cc:4584] TS 3263eeebd4e0430eae5159b4615f5b4e (127.2.191.65:33865): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet eea382f54c10428b934f69458c611980: Network error: Client connection negotiation failed: client connection to 127.2.191.65:33865: connect: Connection refused (error 111)
I20260808 05:58:57.630442 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 23514
I20260808 05:58:57.638127 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 23145
2026-08-08T05:58:57Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (1171 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:58:57 dist-test-slave-qg60 krb5kdc[23699](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:58:57 dist-test-slave-qg60 krb5kdc[23699](info): set up 2 sockets
Aug 08 05:58:57 dist-test-slave-qg60 krb5kdc[23699](info): commencing operation
krb5kdc: starting...
W20260808 05:58:58.751729 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:58:58 dist-test-slave-qg60 krb5kdc[23699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:58:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:58:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:58:58.890465 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42939
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:39517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:42939
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:59.014430 23713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:59.014753 23713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:59.014798 23713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:59.018978 23713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:58:59.019045 23713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:59.019065 23713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:59.019083 23713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:58:59.019098 23713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:58:59.024456 23713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:39517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:42939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:59.025622 23713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:59.026679 23713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:59.035732 23719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:59.035840 23718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:59.035815 23721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:59.036299 23713 server_base.cc:1034] running on GCE node
I20260808 05:58:59.037000 23713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:59.038323 23713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:59.039561 23713 hybrid_clock.cc:648] HybridClock initialized: now 1786168739039544 us; error 33 us; skew 500 ppm
Aug 08 05:58:59 dist-test-slave-qg60 krb5kdc[23699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168739, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:59.042861 23713 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:58:59.043977 23713 webserver.cc:460] Webserver started at http://127.2.191.126:35921/ using document root <none> and password file <none>
I20260808 05:58:59.044575 23713 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:59.044670 23713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:59.044947 23713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:59.047075 23713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "9a355039393a4680af110df0214bfbb5"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "d080aad75b78df9fd2d37506633da7c9"
server_key_iv: "6d3f2136e137eb53dbfe1d01836b227a"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.047657 23713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "9a355039393a4680af110df0214bfbb5"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "d080aad75b78df9fd2d37506633da7c9"
server_key_iv: "6d3f2136e137eb53dbfe1d01836b227a"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.051604 23713 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:58:59.054061 23728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.055480 23713 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:58:59.055641 23713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "9a355039393a4680af110df0214bfbb5"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "d080aad75b78df9fd2d37506633da7c9"
server_key_iv: "6d3f2136e137eb53dbfe1d01836b227a"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.055773 23713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:59.083729 23713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:59.086884 23713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:59.087128 23713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:59.094699 23713 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:42939
I20260808 05:58:59.095033 23784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:42939 every 8 connection(s)
I20260808 05:58:59.095750 23713 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:58:59.098820 23785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:59.098920 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 23713
I20260808 05:58:59.099049 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:58:59.099378 2813 external_mini_cluster.cc:1428] Setting key faaa80fd7152f5b5f8f95f2c49178de3
I20260808 05:58:59.106469 23785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5: Bootstrap starting.
I20260808 05:58:59.109401 23785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5: Neither blocks nor log segments found. Creating new log.
Aug 08 05:58:59 dist-test-slave-qg60 krb5kdc[23699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168738, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:59.110360 23785 log.cc:824] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:59.112598 23785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5: No bootstrap required, opened a new log
I20260808 05:58:59.115525 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.100902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52386 (local address 127.2.191.126:42939)
0808 05:58:59.101339 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:59.101358 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:59.101402 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:58:59.102546 (+ 1144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:59.102570 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:59.102999 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:59.103382 (+ 383us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:59.104078 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.105635 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.106545 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.107231 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.107399 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.110570 (+ 3171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:59.110576 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:59.110593 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:59.110628 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:59.112476 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.113026 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.113031 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.113035 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.113186 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.113499 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.113501 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.113502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.113931 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:59.114081 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:59.114405 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 05:58:59.114717 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":282,"thread_start_us":118,"threads_started":1}
I20260808 05:58:59.117024 23785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a355039393a4680af110df0214bfbb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42939 } }
I20260808 05:58:59.117309 23785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:59.117367 23785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a355039393a4680af110df0214bfbb5, State: Initialized, Role: FOLLOWER
I20260808 05:58:59.117813 23785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a355039393a4680af110df0214bfbb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42939 } }
I20260808 05:58:59.117995 23785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:58:59.118077 23785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:58:59.118203 23785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:58:59.119203 23785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a355039393a4680af110df0214bfbb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42939 } }
I20260808 05:58:59.119554 23785 leader_election.cc:302] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a355039393a4680af110df0214bfbb5; no voters:
I20260808 05:58:59.119899 23785 leader_election.cc:288] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:58:59.120023 23790 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:58:59.120291 23790 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [term 1 LEADER]: Becoming Leader. State: Replica: 9a355039393a4680af110df0214bfbb5, State: Running, Role: LEADER
I20260808 05:58:59.120666 23790 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a355039393a4680af110df0214bfbb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42939 } }
I20260808 05:58:59.121277 23785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:58:59.122421 23791 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a355039393a4680af110df0214bfbb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a355039393a4680af110df0214bfbb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42939 } } }
I20260808 05:58:59.122565 23791 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:59.122756 23792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a355039393a4680af110df0214bfbb5. Latest consensus state: current_term: 1 leader_uuid: "9a355039393a4680af110df0214bfbb5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a355039393a4680af110df0214bfbb5" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42939 } } }
I20260808 05:58:59.122853 23792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:58:59.123208 23800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:58:59.126554 23800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:58:59.133263 23800 catalog_manager.cc:1347] Generated new cluster ID: 1f003409657549ec9f1bffde7ee81e1c
I20260808 05:58:59.133361 23800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:58:59.160115 23800 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:58:59.161382 23800 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:58:59.166889 23800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5: Generated new TSK 0
I20260808 05:58:59.167704 23800 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.2.191.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
Entry for principal kudu/127.2.191.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab.
I20260808 05:58:59.211942 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42939
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:39517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:59.348404 23812 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:59.348681 23812 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:59.348779 23812 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:59.352969 23812 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:59.353027 23812 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:59.353088 23812 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:58:59.358319 23812 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:39517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.65.keytab
--principal=kudu/127.2.191.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23812
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:59.359375 23812 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:59.360476 23812 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:59.370692 23817 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:59.370707 23818 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:59.370709 23820 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:59.371120 23812 server_base.cc:1034] running on GCE node
I20260808 05:58:59.371587 23812 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:59.372258 23812 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:59.373450 23812 hybrid_clock.cc:648] HybridClock initialized: now 1786168739373439 us; error 35 us; skew 500 ppm
Aug 08 05:58:59 dist-test-slave-qg60 krb5kdc[23699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168739, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:59.376391 23812 init.cc:377] Logged in from keytab as kudu/127.2.191.65@KRBTEST.COM (short username kudu)
I20260808 05:58:59.377398 23812 webserver.cc:460] Webserver started at http://127.2.191.65:38497/ using document root <none> and password file <none>
I20260808 05:58:59.377947 23812 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:59.378023 23812 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:59.378201 23812 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:59.380439 23812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "5346ba3361a044ed8c97bbaf447ea03c"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "58b23ae3a82bd3e0f5c51601be52d4ee"
server_key_iv: "5dc874517860f0714b4ddebfaa55f08e"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.381135 23812 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "5346ba3361a044ed8c97bbaf447ea03c"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "58b23ae3a82bd3e0f5c51601be52d4ee"
server_key_iv: "5dc874517860f0714b4ddebfaa55f08e"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.385356 23812 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:58:59.387871 23827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.389384 23812 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:58:59.389489 23812 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "5346ba3361a044ed8c97bbaf447ea03c"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "58b23ae3a82bd3e0f5c51601be52d4ee"
server_key_iv: "5dc874517860f0714b4ddebfaa55f08e"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.389583 23812 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:59.410926 23812 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:59.414544 23812 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:59.414718 23812 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:59.415304 23812 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:59.416144 23812 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:59.416194 23812 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.416236 23812 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:59.416252 23812 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.426537 23812 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:38225
I20260808 05:58:59.426584 23945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:38225 every 8 connection(s)
I20260808 05:58:59.427518 23812 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:58:59.431488 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 23812
I20260808 05:58:59.431660 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:58:59.431983 2813 external_mini_cluster.cc:1428] Setting key 729810c98201f9cadfef3c2b9478fec4
Aug 08 05:58:59 dist-test-slave-qg60 krb5kdc[23699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168739, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.65@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.66@KRBTEST.COM; defaulting to no policy
I20260808 05:58:59.444399 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.429634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:55269 (local address 127.2.191.126:42939)
0808 05:58:59.429785 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:59.429789 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:59.430657 (+ 868us) server_negotiation.cc:407] Connection header received
0808 05:58:59.432221 (+ 1564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:59.432225 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:59.432287 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:59.432404 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:59.433952 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.434832 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.436185 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.436459 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.436587 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.439592 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:59.439598 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:59.439601 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:59.439641 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:59.441549 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.442333 (+ 784us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.442336 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.442337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.442491 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.442978 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.442980 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.442982 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.443182 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:59.443261 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:59.444067 (+ 806us) server_negotiation.cc:299] Negotiation successful
0808 05:58:59.444194 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:58:59.445533 23949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.429970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42939 (local address 127.2.191.65:55269)
0808 05:58:59.430484 (+ 514us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:59.430536 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:59.431940 (+ 1404us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:59.432603 (+ 663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:59.432613 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:59.433161 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:59.433788 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.433807 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.435005 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.435008 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.436043 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.436054 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.436639 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.436643 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.436881 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.437563 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:59.437580 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:59.439378 (+ 1798us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:59.441706 (+ 2328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:59.441716 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:59.441736 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:59.442187 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:59.442608 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:59.442612 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:59.442615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:59.442850 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:59.443308 (+ 458us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:59.443319 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:59.443754 (+ 435us) client_negotiation.cc:769] Sending connection context
0808 05:58:59.444021 (+ 267us) client_negotiation.cc:240] Negotiation successful
0808 05:58:59.444447 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":120,"threads_started":1}
I20260808 05:58:59.446930 23946 heartbeater.cc:347] Connected to a master server at 127.2.191.126:42939
I20260808 05:58:59.447304 23946 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.66@KRBTEST.COM" created.
I20260808 05:58:59.447932 23946 heartbeater.cc:511] Master 127.2.191.126:42939 requested a full tablet report, sending...
I20260808 05:58:59.449775 23747 ts_manager.cc:194] Registered new tserver with Master: 5346ba3361a044ed8c97bbaf447ea03c (127.2.191.65:38225)
I20260808 05:58:59.451197 23747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.65@KRBTEST.COM'} at 127.2.191.65:55269
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
Entry for principal kudu/127.2.191.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab.
I20260808 05:58:59.467996 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42939
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:39517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:59.583506 23952 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:59.583818 23952 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:59.583899 23952 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:59.588042 23952 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:59.588151 23952 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:59.588251 23952 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:58:59.593997 23952 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:39517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.66.keytab
--principal=kudu/127.2.191.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23952
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:59.595160 23952 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:59.596215 23952 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:59.605906 23960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:59.605906 23958 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:59.605952 23957 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:59.606281 23952 server_base.cc:1034] running on GCE node
I20260808 05:58:59.606693 23952 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:59.607419 23952 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:59.608614 23952 hybrid_clock.cc:648] HybridClock initialized: now 1786168739608575 us; error 50 us; skew 500 ppm
Aug 08 05:58:59 dist-test-slave-qg60 krb5kdc[23699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168739, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:59.611598 23952 init.cc:377] Logged in from keytab as kudu/127.2.191.66@KRBTEST.COM (short username kudu)
I20260808 05:58:59.612586 23952 webserver.cc:460] Webserver started at http://127.2.191.66:33863/ using document root <none> and password file <none>
I20260808 05:58:59.613382 23952 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:59.613495 23952 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:59.613752 23952 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:59.616212 23952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "310995856cde4583be1386283a008525"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "29c937123a77d15700d22d007d0ef3d3"
server_key_iv: "82a0ec47faee1b53998e702d5eb0a54b"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.616921 23952 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "310995856cde4583be1386283a008525"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "29c937123a77d15700d22d007d0ef3d3"
server_key_iv: "82a0ec47faee1b53998e702d5eb0a54b"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.621433 23952 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:58:59.624428 23968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.625982 23952 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:58:59.626099 23952 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "310995856cde4583be1386283a008525"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "29c937123a77d15700d22d007d0ef3d3"
server_key_iv: "82a0ec47faee1b53998e702d5eb0a54b"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.626259 23952 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:59.647212 23952 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:59.650358 23952 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:59.650578 23952 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:59.651212 23952 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:59.652081 23952 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:59.652133 23952 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.652199 23952 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:59.652232 23952 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.662130 23952 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:45689
I20260808 05:58:59.662204 24086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:45689 every 8 connection(s)
I20260808 05:58:59.663108 23952 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:58:59.666031 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 23952
I20260808 05:58:59.666173 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:58:59.666471 2813 external_mini_cluster.cc:1428] Setting key 03e31d38105dfb7d2af8072a5724d9f9
Aug 08 05:58:59 dist-test-slave-qg60 krb5kdc[23699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168739, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.66@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.67@KRBTEST.COM; defaulting to no policy
I20260808 05:58:59.678819 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.665047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:37457 (local address 127.2.191.126:42939)
0808 05:58:59.665195 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:59.665199 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:59.666034 (+ 835us) server_negotiation.cc:407] Connection header received
0808 05:58:59.667877 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:59.667881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:59.667933 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:59.668024 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:59.669757 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.670376 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.671616 (+ 1240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.671848 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.671964 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.674753 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:59.674757 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:59.674759 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:59.674784 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:59.676499 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.677152 (+ 653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.677156 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.677158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.677247 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.677632 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.677635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.677637 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.677841 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:59.677954 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:59.678512 (+ 558us) server_negotiation.cc:299] Negotiation successful
0808 05:58:59.678644 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.67@KRBTEST.COM" created.
I20260808 05:58:59.679862 24089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.665374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42939 (local address 127.2.191.66:37457)
0808 05:58:59.665857 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:59.665903 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:59.667624 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:59.668279 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:59.668289 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:59.668836 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:59.669589 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.669611 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.670522 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.670526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.671483 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.671492 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.672004 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.672017 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.672186 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.672879 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:59.672895 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:59.674574 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:59.676680 (+ 2106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:59.676686 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:59.676703 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:59.677052 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:59.677359 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:59.677362 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:59.677364 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:59.677522 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:59.677951 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:59.677958 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:59.678253 (+ 295us) client_negotiation.cc:769] Sending connection context
0808 05:58:59.678460 (+ 207us) client_negotiation.cc:240] Negotiation successful
0808 05:58:59.678803 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"thread_start_us":130,"threads_started":1}
I20260808 05:58:59.681213 24087 heartbeater.cc:347] Connected to a master server at 127.2.191.126:42939
I20260808 05:58:59.681489 24087 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:59.682121 24087 heartbeater.cc:511] Master 127.2.191.126:42939 requested a full tablet report, sending...
I20260808 05:58:59.683282 23747 ts_manager.cc:194] Registered new tserver with Master: 310995856cde4583be1386283a008525 (127.2.191.66:45689)
I20260808 05:58:59.684167 23747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.66@KRBTEST.COM'} at 127.2.191.66:37457
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
Entry for principal kudu/127.2.191.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab.
I20260808 05:58:59.700126 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42939
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:39517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:58:59.815658 24092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:58:59.815975 24092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:58:59.816021 24092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:58:59.820197 24092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:58:59.820264 24092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:58:59.820324 24092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:58:59.825961 24092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:39517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.67.keytab
--principal=kudu/127.2.191.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:42939
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24092
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:58:59.827175 24092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:58:59.828178 24092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:58:59.838483 24101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:59.838495 24099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:58:59.838483 24098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:58:59.838671 24092 server_base.cc:1034] running on GCE node
I20260808 05:58:59.839239 24092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:58:59.839987 24092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:58:59.841171 24092 hybrid_clock.cc:648] HybridClock initialized: now 1786168739841157 us; error 26 us; skew 500 ppm
Aug 08 05:58:59 dist-test-slave-qg60 krb5kdc[23699](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168739, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:58:59.844156 24092 init.cc:377] Logged in from keytab as kudu/127.2.191.67@KRBTEST.COM (short username kudu)
I20260808 05:58:59.845093 24092 webserver.cc:460] Webserver started at http://127.2.191.67:36455/ using document root <none> and password file <none>
I20260808 05:58:59.845765 24092 fs_manager.cc:359] Metadata directory not provided
I20260808 05:58:59.845832 24092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:58:59.846004 24092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:58:59.848044 24092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "c713117df90b45f1aa1d8f38b2fc6207"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "95e99c7270daf59d32c33ead6b226fc1"
server_key_iv: "1b99358ca6efb637c8f60a94ff9b48cf"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.848592 24092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "c713117df90b45f1aa1d8f38b2fc6207"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "95e99c7270daf59d32c33ead6b226fc1"
server_key_iv: "1b99358ca6efb637c8f60a94ff9b48cf"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.852427 24092 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260808 05:58:59.854949 24108 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.856248 24092 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:58:59.856392 24092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "c713117df90b45f1aa1d8f38b2fc6207"
format_stamp: "Formatted at 2026-08-08 05:58:59 on dist-test-slave-qg60"
server_key: "95e99c7270daf59d32c33ead6b226fc1"
server_key_iv: "1b99358ca6efb637c8f60a94ff9b48cf"
server_key_version: "encryptionkey@0"
I20260808 05:58:59.856510 24092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:58:59.880285 24092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:58:59.883448 24092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:58:59.883632 24092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:58:59.884191 24092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:58:59.885114 24092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:58:59.885167 24092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.885210 24092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:58:59.885228 24092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:58:59.894644 24092 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:44355
I20260808 05:58:59.894670 24226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:44355 every 8 connection(s)
I20260808 05:58:59.895605 24092 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:58:59.898636 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 24092
I20260808 05:58:59.898805 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:58:59.899168 2813 external_mini_cluster.cc:1428] Setting key bfc3b6585af0dfb718e91487410845eb
Aug 08 05:58:59 dist-test-slave-qg60 krb5kdc[23699](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168739, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.67@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:58:59.909883 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.897597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:48551 (local address 127.2.191.126:42939)
0808 05:58:59.897746 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:59.897750 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:59.898611 (+ 861us) server_negotiation.cc:407] Connection header received
0808 05:58:59.900331 (+ 1720us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:59.900333 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:59.900379 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:59.900480 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:59.901982 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.902506 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.903659 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.903864 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.903939 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.906497 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:59.906500 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:59.906502 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:59.906526 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:59.907997 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.908468 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.908471 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.908472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.908546 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.908915 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.908929 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.908930 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.909126 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:59.909205 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:59.909663 (+ 458us) server_negotiation.cc:299] Negotiation successful
0808 05:58:59.909760 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:58:59.910756 24229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.897908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42939 (local address 127.2.191.67:48551)
0808 05:58:59.898406 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:59.898471 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:59.900112 (+ 1641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:59.900663 (+ 551us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:59.900672 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:59.901220 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:58:59.901848 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.901862 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.902619 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.902622 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.903552 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.903562 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.904041 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.904044 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.904186 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.904803 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:58:59.904822 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:58:59.906345 (+ 1523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:58:59.908108 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:59.908112 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:59.908125 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:59.908379 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:59.908626 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:58:59.908628 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:58:59.908630 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:58:59.908835 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:58:59.909220 (+ 385us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:58:59.909225 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:58:59.909446 (+ 221us) client_negotiation.cc:769] Sending connection context
0808 05:58:59.909601 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 05:58:59.909842 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"thread_start_us":121,"threads_started":1}
I20260808 05:58:59.912072 24227 heartbeater.cc:347] Connected to a master server at 127.2.191.126:42939
I20260808 05:58:59.912345 24227 heartbeater.cc:464] Registering TS with master...
I20260808 05:58:59.912943 24227 heartbeater.cc:511] Master 127.2.191.126:42939 requested a full tablet report, sending...
I20260808 05:58:59.914041 23747 ts_manager.cc:194] Registered new tserver with Master: c713117df90b45f1aa1d8f38b2fc6207 (127.2.191.67:44355)
I20260808 05:58:59.914633 23747 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.2.191.67@KRBTEST.COM'} at 127.2.191.67:48551
I20260808 05:58:59.925240 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:58:59.934960 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.927406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52394 (local address 127.2.191.126:42939)
0808 05:58:59.927544 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:59.927548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:59.927723 (+ 175us) server_negotiation.cc:407] Connection header received
0808 05:58:59.927831 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:59.927833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:59.927873 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:59.927944 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:58:59.928671 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.929277 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.930191 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.930403 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.930486 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.931940 (+ 1454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:58:59.931943 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:58:59.931945 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:58:59.931969 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:58:59.933511 (+ 1542us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.933899 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.933901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.933903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.933979 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:58:59.934209 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:58:59.934212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:58:59.934213 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:58:59.934431 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:58:59.934534 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:59.934747 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 05:58:59.934837 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:58:59.938006 23747 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52394:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:58:59.941080 23747 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:58:59.955689 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.949627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33436 (local address 127.2.191.67:44355)
0808 05:58:59.950021 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:59.950037 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:59.950529 (+ 492us) server_negotiation.cc:407] Connection header received
0808 05:58:59.950640 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:59.950647 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:59.950883 (+ 236us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:59.951046 (+ 163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:59.951534 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.952429 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.953992 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.954841 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.954953 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.955106 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:59.955393 (+ 287us) server_negotiation.cc:299] Negotiation successful
0808 05:58:59.955505 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":122,"threads_started":1}
I20260808 05:58:59.955785 24242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.950167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:38225 (local address 127.0.0.1:54252)
0808 05:58:59.950995 (+ 828us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:59.951007 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:59.951089 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:59.951750 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:59.951753 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:59.951773 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:59.951857 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.951863 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.953203 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.953207 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.954313 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.954323 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.955173 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.955177 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.955261 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.955294 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 05:58:59.955339 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:58:59.955508 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":762,"mutex_wait_us":28,"thread_start_us":103,"threads_started":1}
I20260808 05:58:59.955837 24241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.949712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:45689 (local address 127.0.0.1:38438)
0808 05:58:59.950281 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:59.950295 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:59.950388 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:59.951332 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:59.951334 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:59.951354 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:59.951461 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.951467 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.953155 (+ 1688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.953159 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.954345 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.954355 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.955427 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.955431 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.955521 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.955544 (+ 23us) client_negotiation.cc:769] Sending connection context
0808 05:58:59.955594 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:58:59.955658 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":495,"mutex_wait_us":28,"thread_start_us":143,"threads_started":1}
I20260808 05:58:59.956059 24243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.950354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54252 (local address 127.2.191.65:38225)
0808 05:58:59.951325 (+ 971us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:59.951331 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:59.951351 (+ 20us) server_negotiation.cc:407] Connection header received
0808 05:58:59.951420 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:59.951426 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:59.951615 (+ 189us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:59.951753 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:59.951989 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.953104 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.954439 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.955034 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.955600 (+ 566us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.955748 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:59.955801 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 05:58:59.955901 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":856,"thread_start_us":120,"threads_started":1}
I20260808 05:58:59.955670 24238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.949431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:44355 (local address 127.0.0.1:33436)
0808 05:58:59.950184 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0808 05:58:59.950240 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 05:58:59.950376 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:58:59.951247 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:58:59.951253 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:58:59.951276 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:58:59.951412 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.951418 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.952566 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.952570 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.953846 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:58:59.953857 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.954985 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.954990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:58:59.955117 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.955205 (+ 88us) client_negotiation.cc:769] Sending connection context
0808 05:58:59.955332 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 05:58:59.955511 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":571,"mutex_wait_us":63,"thread_start_us":89,"threads_started":1}
I20260808 05:58:59.956579 24244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:58:59.950502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38438 (local address 127.2.191.66:45689)
0808 05:58:59.950838 (+ 336us) server_negotiation.cc:206] Beginning negotiation
0808 05:58:59.950852 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:58:59.950876 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:58:59.950957 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:58:59.950963 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:58:59.951178 (+ 215us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:58:59.951613 (+ 435us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:58:59.951791 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.953009 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.954480 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:58:59.955259 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:58:59.956145 (+ 886us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:58:59.956297 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 05:58:59.956343 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 05:58:59.956428 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":228,"thread_start_us":126,"threads_started":1}
I20260808 05:58:59.958943 23877 tablet_service.cc:1467] Processing CreateTablet for tablet 516a2e0c12b64107bcf3998d766e9b83 (DEFAULT_TABLE table=test-table [id=5f18c8358fa143d0b47b3e58b3018312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:59.959292 24158 tablet_service.cc:1467] Processing CreateTablet for tablet 516a2e0c12b64107bcf3998d766e9b83 (DEFAULT_TABLE table=test-table [id=5f18c8358fa143d0b47b3e58b3018312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:59.959292 24017 tablet_service.cc:1467] Processing CreateTablet for tablet 516a2e0c12b64107bcf3998d766e9b83 (DEFAULT_TABLE table=test-table [id=5f18c8358fa143d0b47b3e58b3018312]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:58:59.960246 23877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516a2e0c12b64107bcf3998d766e9b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:59.960323 24017 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516a2e0c12b64107bcf3998d766e9b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:59.960331 24158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516a2e0c12b64107bcf3998d766e9b83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:58:59.966991 24245 tablet_bootstrap.cc:492] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c: Bootstrap starting.
I20260808 05:58:59.968492 24246 tablet_bootstrap.cc:492] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: Bootstrap starting.
I20260808 05:58:59.969089 24247 tablet_bootstrap.cc:492] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: Bootstrap starting.
I20260808 05:58:59.969408 24245 tablet_bootstrap.cc:654] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:59.970295 24245 log.cc:824] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:59.971176 24246 tablet_bootstrap.cc:654] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:59.971207 24247 tablet_bootstrap.cc:654] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: Neither blocks nor log segments found. Creating new log.
I20260808 05:58:59.972121 24246 log.cc:824] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:59.972271 24245 tablet_bootstrap.cc:492] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c: No bootstrap required, opened a new log
I20260808 05:58:59.972383 24247 log.cc:824] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: Log is configured to *not* fsync() on all Append() calls
I20260808 05:58:59.972513 24245 ts_tablet_manager.cc:1397] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:58:59.974277 24247 tablet_bootstrap.cc:492] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: No bootstrap required, opened a new log
I20260808 05:58:59.974273 24246 tablet_bootstrap.cc:492] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: No bootstrap required, opened a new log
I20260808 05:58:59.974472 24247 ts_tablet_manager.cc:1397] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:58:59.974472 24246 ts_tablet_manager.cc:1397] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:58:59.976598 24245 raft_consensus.cc:348] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:58:59.976903 24245 raft_consensus.cc:374] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:59.976990 24245 raft_consensus.cc:729] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5346ba3361a044ed8c97bbaf447ea03c, State: Initialized, Role: FOLLOWER
I20260808 05:58:59.977478 24245 consensus_queue.cc:260] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:58:59.978143 23946 heartbeater.cc:503] Master 127.2.191.126:42939 was elected leader, sending a full tablet report...
I20260808 05:58:59.978372 24247 raft_consensus.cc:348] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:58:59.978372 24246 raft_consensus.cc:348] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:58:59.978574 24245 ts_tablet_manager.cc:1428] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:58:59.978628 24247 raft_consensus.cc:374] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:59.978633 24246 raft_consensus.cc:374] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:58:59.978682 24247 raft_consensus.cc:729] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c713117df90b45f1aa1d8f38b2fc6207, State: Initialized, Role: FOLLOWER
I20260808 05:58:59.978682 24246 raft_consensus.cc:729] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 310995856cde4583be1386283a008525, State: Initialized, Role: FOLLOWER
I20260808 05:58:59.979111 24247 consensus_queue.cc:260] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:58:59.979102 24246 consensus_queue.cc:260] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:58:59.979746 24087 heartbeater.cc:503] Master 127.2.191.126:42939 was elected leader, sending a full tablet report...
I20260808 05:58:59.980050 24246 ts_tablet_manager.cc:1428] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:58:59.980050 24247 ts_tablet_manager.cc:1428] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:58:59.980417 24227 heartbeater.cc:503] Master 127.2.191.126:42939 was elected leader, sending a full tablet report...
I20260808 05:59:00.065752 24252 raft_consensus.cc:482] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:59:00.066071 24252 raft_consensus.cc:504] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:59:00.067323 24252 leader_election.cc:288] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c713117df90b45f1aa1d8f38b2fc6207 (127.2.191.67:44355), 5346ba3361a044ed8c97bbaf447ea03c (127.2.191.65:38225)
I20260808 05:59:00.071568 24089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.067654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:44355 (local address 127.2.191.66:37177)
0808 05:59:00.067794 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:00.067810 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:00.067921 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:00.068202 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:00.068206 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:00.068224 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:59:00.068351 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:00.068358 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.069340 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.069343 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:00.070417 (+ 1074us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:00.070428 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.071215 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.071218 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:00.071301 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.071321 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 05:59:00.071387 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 05:59:00.071441 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260808 05:59:00.071640 24240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.067758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:37177 (local address 127.2.191.67:44355)
0808 05:59:00.067893 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:00.067896 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:00.067912 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:59:00.068011 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:00.068015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:00.068069 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:00.068190 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:59:00.068486 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.069230 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.070575 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.071091 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.071223 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.071283 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:00.071426 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:59:00.071501 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:59:00.072316 24254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.067982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:38225 (local address 127.2.191.66:42271)
0808 05:59:00.068486 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:00.068499 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:00.068584 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:00.068841 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:00.068843 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:00.068859 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:59:00.069029 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:00.069035 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.069822 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.069826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:00.070885 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:00.070892 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.071861 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.071868 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:00.071977 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.072043 (+ 66us) client_negotiation.cc:769] Sending connection context
0808 05:59:00.072125 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 05:59:00.072204 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":434,"mutex_wait_us":9,"thread_start_us":141,"threads_started":1}
I20260808 05:59:00.072386 24243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.068164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:42271 (local address 127.2.191.65:38225)
0808 05:59:00.068301 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:00.068305 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:00.068585 (+ 280us) server_negotiation.cc:407] Connection header received
0808 05:59:00.068647 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:00.068650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:00.068697 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:00.068803 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:59:00.069150 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.069696 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.071012 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.071662 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.071786 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.071845 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:00.072176 (+ 331us) server_negotiation.cc:299] Negotiation successful
0808 05:59:00.072273 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 05:59:00.072499 24180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516a2e0c12b64107bcf3998d766e9b83" candidate_uuid: "310995856cde4583be1386283a008525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c713117df90b45f1aa1d8f38b2fc6207" is_pre_election: true
I20260808 05:59:00.072907 24180 raft_consensus.cc:2454] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 310995856cde4583be1386283a008525 in term 0.
I20260808 05:59:00.073114 23899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516a2e0c12b64107bcf3998d766e9b83" candidate_uuid: "310995856cde4583be1386283a008525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5346ba3361a044ed8c97bbaf447ea03c" is_pre_election: true
I20260808 05:59:00.073439 23899 raft_consensus.cc:2454] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 310995856cde4583be1386283a008525 in term 0.
I20260808 05:59:00.073508 23971 leader_election.cc:302] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 310995856cde4583be1386283a008525, c713117df90b45f1aa1d8f38b2fc6207; no voters:
I20260808 05:59:00.073868 24252 raft_consensus.cc:2781] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:59:00.073968 24252 raft_consensus.cc:482] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:59:00.074015 24252 raft_consensus.cc:3037] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:00.075143 24252 raft_consensus.cc:504] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:59:00.075601 24252 leader_election.cc:288] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [CANDIDATE]: Term 1 election: Requested vote from peers c713117df90b45f1aa1d8f38b2fc6207 (127.2.191.67:44355), 5346ba3361a044ed8c97bbaf447ea03c (127.2.191.65:38225)
I20260808 05:59:00.076177 23899 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516a2e0c12b64107bcf3998d766e9b83" candidate_uuid: "310995856cde4583be1386283a008525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5346ba3361a044ed8c97bbaf447ea03c"
I20260808 05:59:00.076201 24180 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516a2e0c12b64107bcf3998d766e9b83" candidate_uuid: "310995856cde4583be1386283a008525" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c713117df90b45f1aa1d8f38b2fc6207"
I20260808 05:59:00.076334 23899 raft_consensus.cc:3037] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:00.076363 24180 raft_consensus.cc:3037] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:00.077616 23899 raft_consensus.cc:2454] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 310995856cde4583be1386283a008525 in term 1.
I20260808 05:59:00.078027 24180 raft_consensus.cc:2454] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 310995856cde4583be1386283a008525 in term 1.
I20260808 05:59:00.078053 23971 leader_election.cc:302] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 310995856cde4583be1386283a008525, 5346ba3361a044ed8c97bbaf447ea03c; no voters:
I20260808 05:59:00.078331 24252 raft_consensus.cc:2781] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:00.078619 24252 raft_consensus.cc:686] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 1 LEADER]: Becoming Leader. State: Replica: 310995856cde4583be1386283a008525, State: Running, Role: LEADER
I20260808 05:59:00.079007 24252 consensus_queue.cc:237] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } }
I20260808 05:59:00.082727 23745 catalog_manager.cc:5495] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 reported cstate change: term changed from 0 to 1, leader changed from <none> to 310995856cde4583be1386283a008525 (127.2.191.66). New cstate: current_term: 1 leader_uuid: "310995856cde4583be1386283a008525" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "310995856cde4583be1386283a008525" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 45689 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 } health_report { overall_health: UNKNOWN } } }
I20260808 05:59:00.116822 24244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.113124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38448 (local address 127.2.191.66:45689)
0808 05:59:00.113289 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:00.113294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:00.113314 (+ 20us) server_negotiation.cc:407] Connection header received
0808 05:59:00.113386 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:00.113388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:00.113442 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:00.113574 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:00.113845 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.114361 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.115277 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.115496 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.115613 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.115941 (+ 328us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:00.116380 (+ 439us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:00.116538 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:00.116577 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 05:59:00.116636 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 05:59:00.123157 24180 raft_consensus.cc:1261] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 1 FOLLOWER]: Refusing update from remote peer 310995856cde4583be1386283a008525: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:59:00.123222 23899 raft_consensus.cc:1261] T 516a2e0c12b64107bcf3998d766e9b83 P 5346ba3361a044ed8c97bbaf447ea03c [term 1 FOLLOWER]: Refusing update from remote peer 310995856cde4583be1386283a008525: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:59:00.123953 24252 consensus_queue.cc:1035] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c713117df90b45f1aa1d8f38b2fc6207" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:59:00.124161 24256 consensus_queue.cc:1035] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5346ba3361a044ed8c97bbaf447ea03c" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 38225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:59:00.136325 24261 mvcc.cc:205] Tried to move back new op lower bound from 7316147159535857664 to 7316147159366856704. Current Snapshot: MvccSnapshot[applied={T|T < 7316147159535857664 or (T in {7316147159535857664})}]
I20260808 05:59:00.142691 23745 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52394:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:59:00.142871 23745 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52394:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:59:00.145465 23745 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a355039393a4680af110df0214bfbb5: Sending DeleteTablet for 3 replicas of tablet 516a2e0c12b64107bcf3998d766e9b83
I20260808 05:59:00.146325 24158 tablet_service.cc:1514] Processing DeleteTablet for tablet 516a2e0c12b64107bcf3998d766e9b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:59:00 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:33436
I20260808 05:59:00.146428 24017 tablet_service.cc:1514] Processing DeleteTablet for tablet 516a2e0c12b64107bcf3998d766e9b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:59:00 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:38438
I20260808 05:59:00.146406 23877 tablet_service.cc:1514] Processing DeleteTablet for tablet 516a2e0c12b64107bcf3998d766e9b83 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:59:00 UTC) from {username='kudu', principal='kudu/127.2.191.126@KRBTEST.COM'} at 127.0.0.1:54252
I20260808 05:59:00.146894 24270 tablet_replica.cc:330] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: stopping tablet replica
I20260808 05:59:00.147192 24270 raft_consensus.cc:2229] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:59:00.147557 24270 raft_consensus.cc:2258] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:59:00.147791 24269 tablet_replica.cc:330] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: stopping tablet replica
I20260808 05:59:00.148069 24269 raft_consensus.cc:2229] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:59:00.148440 24269 raft_consensus.cc:2258] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:59:00.148459 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 23812
I20260808 05:59:00.149928 24270 ts_tablet_manager.cc:1905] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:59:00.151917 24269 ts_tablet_manager.cc:1905] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:59:00.153323 24270 ts_tablet_manager.cc:1918] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:59:00.153435 24270 log.cc:1196] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/516a2e0c12b64107bcf3998d766e9b83
I20260808 05:59:00.153827 24270 ts_tablet_manager.cc:1939] T 516a2e0c12b64107bcf3998d766e9b83 P 310995856cde4583be1386283a008525: Deleting consensus metadata
I20260808 05:59:00.155257 23730 catalog_manager.cc:4841] TS 310995856cde4583be1386283a008525 (127.2.191.66:45689): tablet 516a2e0c12b64107bcf3998d766e9b83 (table test-table [id=5f18c8358fa143d0b47b3e58b3018312]) successfully deleted
I20260808 05:59:00.155598 24269 ts_tablet_manager.cc:1918] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:59:00.155700 24269 log.cc:1196] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/516a2e0c12b64107bcf3998d766e9b83
I20260808 05:59:00.156060 24269 ts_tablet_manager.cc:1939] T 516a2e0c12b64107bcf3998d766e9b83 P c713117df90b45f1aa1d8f38b2fc6207: Deleting consensus metadata
I20260808 05:59:00.157366 23731 catalog_manager.cc:4841] TS c713117df90b45f1aa1d8f38b2fc6207 (127.2.191.67:44355): tablet 516a2e0c12b64107bcf3998d766e9b83 (table test-table [id=5f18c8358fa143d0b47b3e58b3018312]) successfully deleted
W20260808 05:59:00.159873 23731 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:38225 (error 108)
I20260808 05:59:00.160899 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 23952
I20260808 05:59:00.161262 24238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.160889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:38225 (local address 127.0.0.1:54262)
0808 05:59:00.161065 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:00.161151 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:38225: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260808 05:59:00.165055 23731 catalog_manager.cc:4584] TS 5346ba3361a044ed8c97bbaf447ea03c (127.2.191.65:38225): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 516a2e0c12b64107bcf3998d766e9b83: Network error: Client connection negotiation failed: client connection to 127.2.191.65:38225: connect: Connection refused (error 111)
I20260808 05:59:00.174852 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 24092
I20260808 05:59:00.182997 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 23713
2026-08-08T05:59:00Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2545 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T05:59:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:00Z Disabled control of system clock
I20260808 05:59:00.216990 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:36793
--webserver_interface=127.2.191.126
--webserver_port=0
--builtin_ntp_servers=127.2.191.84:40053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:36793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:59:00.333603 24276 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:00.333909 24276 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:00.333947 24276 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:00.338176 24276 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:00.338244 24276 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:00.338259 24276 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:00.338277 24276 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:00.338325 24276 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:00.343429 24276 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:36793
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:36793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24276
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:00.344581 24276 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:00.346029 24276 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:00.354988 24281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:00.355269 24276 server_base.cc:1034] running on GCE node
W20260808 05:59:00.355031 24282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:00.354982 24284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:00.356053 24276 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:00.357312 24276 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:00.358484 24276 hybrid_clock.cc:648] HybridClock initialized: now 1786168740358466 us; error 30 us; skew 500 ppm
I20260808 05:59:00.360425 24276 webserver.cc:460] Webserver started at http://127.2.191.126:39217/ using document root <none> and password file <none>
I20260808 05:59:00.361112 24276 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:00.361183 24276 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:00.361429 24276 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:00.363695 24276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "d5daf25099f04ba68e0a24279aa489ce"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "c4baecdf35fc0907ba09879ad3ad07c7"
server_key_iv: "300bc0a50c6fc74c786b5da173c33c9e"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.364290 24276 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "d5daf25099f04ba68e0a24279aa489ce"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "c4baecdf35fc0907ba09879ad3ad07c7"
server_key_iv: "300bc0a50c6fc74c786b5da173c33c9e"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.368206 24276 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:59:00.370815 24290 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:00.372072 24276 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s
I20260808 05:59:00.372236 24276 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "d5daf25099f04ba68e0a24279aa489ce"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "c4baecdf35fc0907ba09879ad3ad07c7"
server_key_iv: "300bc0a50c6fc74c786b5da173c33c9e"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.372362 24276 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:00.387344 24276 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:00.388077 24276 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:00.388288 24276 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:00.395891 24276 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:36793
I20260808 05:59:00.395905 24344 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:36793 every 8 connection(s)
I20260808 05:59:00.397049 24276 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:00.400383 24345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:00.403767 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 24276
I20260808 05:59:00.403927 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:00.404201 2813 external_mini_cluster.cc:1428] Setting key ee90c6f51fd6232d9023adb0f9872ded
I20260808 05:59:00.407052 24345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce: Bootstrap starting.
I20260808 05:59:00.409571 24345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:00.410415 24345 log.cc:824] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:00.412482 24345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce: No bootstrap required, opened a new log
I20260808 05:59:00.414075 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.405788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57790 (local address 127.2.191.126:36793)
0808 05:59:00.406517 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:00.406534 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:00.406570 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:59:00.407264 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:00.407284 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:00.407729 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:00.408076 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:00.408545 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.409605 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.410535 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.411054 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.411253 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.412164 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:00.412169 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:00.412183 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:00.412605 (+ 422us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:00.412684 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:00.412717 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:00.412870 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:00.413033 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 05:59:00.413339 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":133,"threads_started":1}
I20260808 05:59:00.416107 24345 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5daf25099f04ba68e0a24279aa489ce" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36793 } }
I20260808 05:59:00.416404 24345 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:00.416467 24345 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5daf25099f04ba68e0a24279aa489ce, State: Initialized, Role: FOLLOWER
I20260808 05:59:00.416956 24345 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5daf25099f04ba68e0a24279aa489ce" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36793 } }
I20260808 05:59:00.417093 24345 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:00.417135 24345 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:00.417207 24345 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:00.418123 24345 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5daf25099f04ba68e0a24279aa489ce" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36793 } }
I20260808 05:59:00.418416 24345 leader_election.cc:302] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5daf25099f04ba68e0a24279aa489ce; no voters:
I20260808 05:59:00.418681 24345 leader_election.cc:288] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:00.418888 24350 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:00.419519 24350 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [term 1 LEADER]: Becoming Leader. State: Replica: d5daf25099f04ba68e0a24279aa489ce, State: Running, Role: LEADER
I20260808 05:59:00.419902 24350 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5daf25099f04ba68e0a24279aa489ce" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36793 } }
I20260808 05:59:00.420136 24345 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:00.421696 24352 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5daf25099f04ba68e0a24279aa489ce. Latest consensus state: current_term: 1 leader_uuid: "d5daf25099f04ba68e0a24279aa489ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5daf25099f04ba68e0a24279aa489ce" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36793 } } }
I20260808 05:59:00.421841 24352 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:00.422251 24351 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5daf25099f04ba68e0a24279aa489ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5daf25099f04ba68e0a24279aa489ce" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36793 } } }
I20260808 05:59:00.422482 24351 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:00.422260 24359 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:00.425531 24359 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:00.430971 24359 catalog_manager.cc:1347] Generated new cluster ID: 8c30776db0fe4ad3bc74659bb4c5d7df
I20260808 05:59:00.431053 24359 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:00.441211 24359 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:00.442559 24359 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:00.452497 24359 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce: Generated new TSK 0
I20260808 05:59:00.453547 24359 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:00.464072 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.65:0
--local_ip_for_outbound_sockets=127.2.191.65
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36793
--builtin_ntp_servers=127.2.191.84:40053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:59:00.589293 24369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:00.589637 24369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:00.589715 24369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:00.594143 24369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:00.594241 24369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:00.594340 24369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.65
I20260808 05:59:00.599813 24369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.2.191.65
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.65
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:00.601269 24369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:00.602783 24369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:00.613284 24376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:00.613373 24369 server_base.cc:1034] running on GCE node
W20260808 05:59:00.613294 24375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:00.613269 24378 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:00.613965 24369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:00.614734 24369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:00.615939 24369 hybrid_clock.cc:648] HybridClock initialized: now 1786168740615885 us; error 69 us; skew 500 ppm
I20260808 05:59:00.618059 24369 webserver.cc:460] Webserver started at http://127.2.191.65:39661/ using document root <none> and password file <none>
I20260808 05:59:00.618702 24369 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:00.618806 24369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:00.619062 24369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:00.621591 24369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/data/instance:
uuid: "5c8609401b164a4797991e5ac846b5d5"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "5d763ca646b0ed99bab63d1acdf9f3cf"
server_key_iv: "40e88982468a3c86191fbb693d7c0040"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.622337 24369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance:
uuid: "5c8609401b164a4797991e5ac846b5d5"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "5d763ca646b0ed99bab63d1acdf9f3cf"
server_key_iv: "40e88982468a3c86191fbb693d7c0040"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.626521 24369 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:00.629313 24384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:00.630622 24369 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:00.630770 24369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/wal
uuid: "5c8609401b164a4797991e5ac846b5d5"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "5d763ca646b0ed99bab63d1acdf9f3cf"
server_key_iv: "40e88982468a3c86191fbb693d7c0040"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.630901 24369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:00.644388 24369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:00.645361 24369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:00.645592 24369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:00.646261 24369 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:59:00.647390 24369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:59:00.647465 24369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:00.647544 24369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:59:00.647588 24369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:00.657647 24369 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.65:46399
I20260808 05:59:00.657671 24506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.65:46399 every 8 connection(s)
I20260808 05:59:00.658674 24369 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/data/info.pb
I20260808 05:59:00.662340 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 24369
I20260808 05:59:00.662494 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-0/wal/instance
I20260808 05:59:00.662803 2813 external_mini_cluster.cc:1428] Setting key 775c168c6c9ac7b3909c1730e7d3d9e5
I20260808 05:59:00.664830 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.66:0
--local_ip_for_outbound_sockets=127.2.191.66
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36793
--builtin_ntp_servers=127.2.191.84:40053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:59:00.668422 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.660584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.65:40779 (local address 127.2.191.126:36793)
0808 05:59:00.660791 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:00.660797 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:00.661858 (+ 1061us) server_negotiation.cc:407] Connection header received
0808 05:59:00.663425 (+ 1567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:00.663429 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:00.663492 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:00.663604 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:00.664510 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.665210 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.666397 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.666630 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.666746 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.667896 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:00.667899 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:00.667901 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:00.667913 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:00.667931 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:00.667939 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:00.668031 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:00.668194 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 05:59:00.668259 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 05:59:00.669401 24509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.661025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36793 (local address 127.2.191.65:40779)
0808 05:59:00.661712 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:00.661754 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:00.663198 (+ 1444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:00.663783 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:00.663790 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:00.663873 (+ 83us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:00.664360 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:00.664371 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.665354 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.665357 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:00.666265 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:00.666274 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.666789 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.666794 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:00.666961 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.667630 (+ 669us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:59:00.667632 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:00.667670 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:59:00.667732 (+ 62us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:00.668032 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:00.668044 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:00.668053 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 05:59:00.668192 (+ 139us) client_negotiation.cc:240] Negotiation successful
0808 05:59:00.668562 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":119,"threads_started":1}
I20260808 05:59:00.670735 24507 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36793
I20260808 05:59:00.671000 24507 heartbeater.cc:464] Registering TS with master...
I20260808 05:59:00.671684 24507 heartbeater.cc:511] Master 127.2.191.126:36793 requested a full tablet report, sending...
I20260808 05:59:00.673623 24307 ts_manager.cc:194] Registered new tserver with Master: 5c8609401b164a4797991e5ac846b5d5 (127.2.191.65:46399)
I20260808 05:59:00.675426 24307 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.65:40779
W20260808 05:59:00.790477 24510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:00.790776 24510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:00.790817 24510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:00.795581 24510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:00.795650 24510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:00.795707 24510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.66
I20260808 05:59:00.800575 24510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.2.191.66
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.66
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:00.801708 24510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:00.803263 24510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:00.814127 24516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:00.814137 24518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:00.814196 24515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:00.814662 24510 server_base.cc:1034] running on GCE node
I20260808 05:59:00.815084 24510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:00.815717 24510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:00.816855 24510 hybrid_clock.cc:648] HybridClock initialized: now 1786168740816819 us; error 49 us; skew 500 ppm
I20260808 05:59:00.818796 24510 webserver.cc:460] Webserver started at http://127.2.191.66:42743/ using document root <none> and password file <none>
I20260808 05:59:00.819381 24510 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:00.819444 24510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:00.819615 24510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:00.821894 24510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/data/instance:
uuid: "29af1a6d7cc4437b860a24210029f459"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "1b398f56535cf2a1d0d977118ef066f2"
server_key_iv: "5dcacdedb11025dc2cca939503ac0002"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.822433 24510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance:
uuid: "29af1a6d7cc4437b860a24210029f459"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "1b398f56535cf2a1d0d977118ef066f2"
server_key_iv: "5dcacdedb11025dc2cca939503ac0002"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.826341 24510 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:59:00.829062 24525 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:00.830354 24510 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260808 05:59:00.830454 24510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/wal
uuid: "29af1a6d7cc4437b860a24210029f459"
format_stamp: "Formatted at 2026-08-08 05:59:00 on dist-test-slave-qg60"
server_key: "1b398f56535cf2a1d0d977118ef066f2"
server_key_iv: "5dcacdedb11025dc2cca939503ac0002"
server_key_version: "encryptionkey@0"
I20260808 05:59:00.830550 24510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:00.844663 24510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:00.845454 24510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:00.845619 24510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:00.846359 24510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:59:00.847321 24510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:59:00.847373 24510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:00.847414 24510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:59:00.847429 24510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:00.857225 24510 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.66:33281
I20260808 05:59:00.857278 24645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.66:33281 every 8 connection(s)
I20260808 05:59:00.858217 24510 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/data/info.pb
I20260808 05:59:00.863027 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 24510
I20260808 05:59:00.863227 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/wal/instance
I20260808 05:59:00.863554 2813 external_mini_cluster.cc:1428] Setting key 3113a57c7976d88bfaf35d3ba4da4cd8
I20260808 05:59:00.865783 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.2.191.67:0
--local_ip_for_outbound_sockets=127.2.191.67
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36793
--builtin_ntp_servers=127.2.191.84:40053
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:59:00.868882 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.860231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.66:47711 (local address 127.2.191.126:36793)
0808 05:59:00.860390 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:00.860394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:00.861693 (+ 1299us) server_negotiation.cc:407] Connection header received
0808 05:59:00.863304 (+ 1611us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:00.863308 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:00.863383 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:00.863492 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:00.864649 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.865340 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.866632 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.866872 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.867029 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.868337 (+ 1308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:00.868340 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:00.868342 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:00.868355 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:00.868376 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:00.868384 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:00.868452 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:00.868648 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 05:59:00.868706 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 05:59:00.870163 24649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:00.860671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36793 (local address 127.2.191.66:47711)
0808 05:59:00.861557 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:00.861601 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:00.862952 (+ 1351us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:00.863708 (+ 756us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:00.863724 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:00.863818 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:00.864501 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:00.864518 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.865480 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.865485 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:00.866493 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:00.866503 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:00.867094 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:00.867099 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:00.867277 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:00.867991 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:59:00.867994 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:00.868058 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:59:00.868155 (+ 97us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:00.868479 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:00.868488 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:00.868495 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 05:59:00.868645 (+ 150us) client_negotiation.cc:240] Negotiation successful
0808 05:59:00.869037 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":176,"threads_started":1}
I20260808 05:59:00.871543 24646 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36793
I20260808 05:59:00.871814 24646 heartbeater.cc:464] Registering TS with master...
I20260808 05:59:00.872382 24646 heartbeater.cc:511] Master 127.2.191.126:36793 requested a full tablet report, sending...
I20260808 05:59:00.873636 24307 ts_manager.cc:194] Registered new tserver with Master: 29af1a6d7cc4437b860a24210029f459 (127.2.191.66:33281)
I20260808 05:59:00.874245 24307 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.66:47711
W20260808 05:59:00.985839 24650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:00.986171 24650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:00.986245 24650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:00.990507 24650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:00.990615 24650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:00.990715 24650 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.2.191.67
I20260808 05:59:00.995688 24650 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40053
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.2.191.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.2.191.67
--webserver_port=0
--tserver_master_addrs=127.2.191.126:36793
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.2.191.67
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:00.996981 24650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:00.998952 24650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:01.009732 24656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:01.009743 24657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:01.010334 24650 server_base.cc:1034] running on GCE node
W20260808 05:59:01.010365 24659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:01.010864 24650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:01.011577 24650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:01.012820 24650 hybrid_clock.cc:648] HybridClock initialized: now 1786168741012793 us; error 38 us; skew 500 ppm
I20260808 05:59:01.014976 24650 webserver.cc:460] Webserver started at http://127.2.191.67:40345/ using document root <none> and password file <none>
I20260808 05:59:01.015615 24650 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:01.015720 24650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:01.015969 24650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:01.018286 24650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/data/instance:
uuid: "b675a857965044c39cc4c3d4668a3ee5"
format_stamp: "Formatted at 2026-08-08 05:59:01 on dist-test-slave-qg60"
server_key: "c8d992aa667d96ef65687ceb0178e0d0"
server_key_iv: "fd2b59c9188efe870ddde72968008489"
server_key_version: "encryptionkey@0"
I20260808 05:59:01.018898 24650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance:
uuid: "b675a857965044c39cc4c3d4668a3ee5"
format_stamp: "Formatted at 2026-08-08 05:59:01 on dist-test-slave-qg60"
server_key: "c8d992aa667d96ef65687ceb0178e0d0"
server_key_iv: "fd2b59c9188efe870ddde72968008489"
server_key_version: "encryptionkey@0"
I20260808 05:59:01.023515 24650 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 05:59:01.026422 24665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:01.027827 24650 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:59:01.027974 24650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/wal
uuid: "b675a857965044c39cc4c3d4668a3ee5"
format_stamp: "Formatted at 2026-08-08 05:59:01 on dist-test-slave-qg60"
server_key: "c8d992aa667d96ef65687ceb0178e0d0"
server_key_iv: "fd2b59c9188efe870ddde72968008489"
server_key_version: "encryptionkey@0"
I20260808 05:59:01.028111 24650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:01.038574 24650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:01.039335 24650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:01.039551 24650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:01.040201 24650 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:59:01.041322 24650 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:59:01.041399 24650 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:01.041476 24650 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:59:01.041529 24650 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:01.051111 24650 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.67:44127
I20260808 05:59:01.051138 24782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.67:44127 every 8 connection(s)
I20260808 05:59:01.052057 24650 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/data/info.pb
I20260808 05:59:01.054150 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 24650
I20260808 05:59:01.054272 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/wal/instance
I20260808 05:59:01.054576 2813 external_mini_cluster.cc:1428] Setting key e2f3b8804c57bcc54f4256c12b52cafa
I20260808 05:59:01.061831 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.054080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:54643 (local address 127.2.191.126:36793)
0808 05:59:01.054234 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:01.054238 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:01.055496 (+ 1258us) server_negotiation.cc:407] Connection header received
0808 05:59:01.057202 (+ 1706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:01.057205 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:01.057251 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:01.057320 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:01.058177 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.058699 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.059940 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.060155 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.060235 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.061349 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:01.061352 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:01.061354 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:01.061366 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:01.061386 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:01.061393 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:01.061448 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:01.061656 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 05:59:01.061713 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260808 05:59:01.062702 24785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.054519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:36793 (local address 127.2.191.67:54643)
0808 05:59:01.055369 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:01.055414 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:01.056993 (+ 1579us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:01.057466 (+ 473us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:01.057472 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:01.057564 (+ 92us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:01.058054 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.058066 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.058853 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.058857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.059823 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.059834 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.060301 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.060304 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.060443 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.061087 (+ 644us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:59:01.061089 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:01.061129 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:59:01.061197 (+ 68us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:01.061510 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:01.061519 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:01.061525 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:59:01.061642 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 05:59:01.061865 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":160,"threads_started":1}
I20260808 05:59:01.063898 24783 heartbeater.cc:347] Connected to a master server at 127.2.191.126:36793
I20260808 05:59:01.064240 24783 heartbeater.cc:464] Registering TS with master...
I20260808 05:59:01.064800 24783 heartbeater.cc:511] Master 127.2.191.126:36793 requested a full tablet report, sending...
I20260808 05:59:01.065840 24307 ts_manager.cc:194] Registered new tserver with Master: b675a857965044c39cc4c3d4668a3ee5 (127.2.191.67:44127)
I20260808 05:59:01.066421 24307 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.2.191.67:54643
I20260808 05:59:01.068825 2813 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:59:01.074890 24348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.070875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57792 (local address 127.2.191.126:36793)
0808 05:59:01.071107 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:01.071113 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:01.071191 (+ 78us) server_negotiation.cc:407] Connection header received
0808 05:59:01.071353 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:01.071357 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:01.071405 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:01.071501 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:01.071804 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.072332 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.073293 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.073514 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.073624 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.074435 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:01.074438 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:01.074440 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:01.074452 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:01.074468 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:01.074476 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:01.074557 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:01.074684 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 05:59:01.074740 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260808 05:59:01.078315 24307 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57792:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:59:01.081533 24307 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:59:01.096997 24797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.090432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37220 (local address 127.2.191.67:44127)
0808 05:59:01.091325 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:01.091337 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:01.091363 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:59:01.091445 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:01.091451 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:01.091691 (+ 240us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:01.092279 (+ 588us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:59:01.092421 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.093640 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.095449 (+ 1809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.096185 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.096384 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.096568 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:01.096680 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 05:59:01.096804 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":141,"threads_started":1}
I20260808 05:59:01.096993 24799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.091015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:33281 (local address 127.0.0.1:55602)
0808 05:59:01.091879 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:01.091894 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:01.092065 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:01.092549 (+ 484us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:01.092551 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:01.092569 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:59:01.092686 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.092695 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.094123 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.094127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.095203 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.095214 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.096325 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.096329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.096448 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.096521 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 05:59:01.096630 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 05:59:01.096807 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":781,"mutex_wait_us":47,"thread_start_us":101,"threads_started":1}
I20260808 05:59:01.096993 24796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.090228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.67:44127 (local address 127.0.0.1:37220)
0808 05:59:01.090630 (+ 402us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:01.090688 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:01.090824 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:01.091882 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:01.091888 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:01.091912 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:59:01.092094 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.092123 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.093773 (+ 1650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.093777 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.095299 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.095310 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.096325 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.096329 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.096452 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.096563 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 05:59:01.096638 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:59:01.096838 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":201,"thread_start_us":118,"threads_started":1}
I20260808 05:59:01.097265 24798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.090639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:46399 (local address 127.0.0.1:42938)
0808 05:59:01.091518 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:01.091534 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:01.091639 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:01.092909 (+ 1270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:01.092911 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:01.092926 (+ 15us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:59:01.092996 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.093000 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.094123 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.094127 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.095425 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.095435 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.096248 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.096252 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.096551 (+ 299us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.096567 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 05:59:01.096641 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:59:01.096824 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":213,"thread_start_us":129,"threads_started":1}
I20260808 05:59:01.097456 24801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.091442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55602 (local address 127.2.191.66:33281)
0808 05:59:01.091833 (+ 391us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:01.091847 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:01.091987 (+ 140us) server_negotiation.cc:407] Connection header received
0808 05:59:01.092196 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:01.092204 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:01.092396 (+ 192us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:01.092552 (+ 156us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:59:01.092820 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.093874 (+ 1054us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.095345 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.096170 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.096922 (+ 752us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.097107 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:01.097169 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 05:59:01.097280 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":153,"threads_started":1}
I20260808 05:59:01.097733 24800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.091112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.2.191.65:46399)
0808 05:59:01.092308 (+ 1196us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:01.092317 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:01.092335 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:59:01.092401 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:01.092405 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:01.092588 (+ 183us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:01.092739 (+ 151us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:59:01.093114 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.094003 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.095557 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.096118 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.096246 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.096459 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:01.097393 (+ 934us) server_negotiation.cc:299] Negotiation successful
0808 05:59:01.097571 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1103,"thread_start_us":149,"threads_started":1}
I20260808 05:59:01.100381 24575 tablet_service.cc:1467] Processing CreateTablet for tablet 428a15781645450a8f5aa634de0ff382 (DEFAULT_TABLE table=test-table [id=6fe5bcfed2ce4a0986f83c60b7b483f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:59:01.100605 24714 tablet_service.cc:1467] Processing CreateTablet for tablet 428a15781645450a8f5aa634de0ff382 (DEFAULT_TABLE table=test-table [id=6fe5bcfed2ce4a0986f83c60b7b483f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:59:01.100595 24435 tablet_service.cc:1467] Processing CreateTablet for tablet 428a15781645450a8f5aa634de0ff382 (DEFAULT_TABLE table=test-table [id=6fe5bcfed2ce4a0986f83c60b7b483f1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:59:01.101727 24575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 428a15781645450a8f5aa634de0ff382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:01.101869 24435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 428a15781645450a8f5aa634de0ff382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:01.101869 24714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 428a15781645450a8f5aa634de0ff382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:01.109820 24804 tablet_bootstrap.cc:492] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: Bootstrap starting.
I20260808 05:59:01.110050 24802 tablet_bootstrap.cc:492] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: Bootstrap starting.
I20260808 05:59:01.111897 24802 tablet_bootstrap.cc:654] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:01.111897 24804 tablet_bootstrap.cc:654] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:01.112677 24802 log.cc:824] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:01.112679 24804 log.cc:824] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:01.113194 24803 tablet_bootstrap.cc:492] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5: Bootstrap starting.
I20260808 05:59:01.115146 24802 tablet_bootstrap.cc:492] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: No bootstrap required, opened a new log
I20260808 05:59:01.115356 24802 ts_tablet_manager.cc:1397] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s
I20260808 05:59:01.115720 24803 tablet_bootstrap.cc:654] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:01.115819 24804 tablet_bootstrap.cc:492] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: No bootstrap required, opened a new log
I20260808 05:59:01.116019 24804 ts_tablet_manager.cc:1397] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:59:01.116658 24803 log.cc:824] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:01.118881 24803 tablet_bootstrap.cc:492] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5: No bootstrap required, opened a new log
I20260808 05:59:01.119082 24803 ts_tablet_manager.cc:1397] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260808 05:59:01.119668 24804 raft_consensus.cc:348] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.119926 24804 raft_consensus.cc:374] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:01.119982 24804 raft_consensus.cc:729] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675a857965044c39cc4c3d4668a3ee5, State: Initialized, Role: FOLLOWER
I20260808 05:59:01.119858 24802 raft_consensus.cc:348] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.120219 24802 raft_consensus.cc:374] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:01.120302 24802 raft_consensus.cc:729] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29af1a6d7cc4437b860a24210029f459, State: Initialized, Role: FOLLOWER
I20260808 05:59:01.120469 24804 consensus_queue.cc:260] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.120769 24802 consensus_queue.cc:260] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.121860 24804 ts_tablet_manager.cc:1428] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20260808 05:59:01.121909 24802 ts_tablet_manager.cc:1428] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20260808 05:59:01.122303 24783 heartbeater.cc:503] Master 127.2.191.126:36793 was elected leader, sending a full tablet report...
I20260808 05:59:01.122303 24646 heartbeater.cc:503] Master 127.2.191.126:36793 was elected leader, sending a full tablet report...
I20260808 05:59:01.123364 24803 raft_consensus.cc:348] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.123651 24803 raft_consensus.cc:374] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:01.123716 24803 raft_consensus.cc:729] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8609401b164a4797991e5ac846b5d5, State: Initialized, Role: FOLLOWER
I20260808 05:59:01.124166 24803 consensus_queue.cc:260] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.124883 24507 heartbeater.cc:503] Master 127.2.191.126:36793 was elected leader, sending a full tablet report...
I20260808 05:59:01.125247 24803 ts_tablet_manager.cc:1428] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
W20260808 05:59:01.159983 24508 tablet.cc:2369] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:59:01.213295 24809 raft_consensus.cc:482] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:59:01.213589 24809 raft_consensus.cc:504] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.214825 24809 leader_election.cc:288] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 29af1a6d7cc4437b860a24210029f459 (127.2.191.66:33281), 5c8609401b164a4797991e5ac846b5d5 (127.2.191.65:46399)
I20260808 05:59:01.218678 24785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.215128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:33281 (local address 127.2.191.67:33389)
0808 05:59:01.215292 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:01.215310 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:01.215425 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:01.215690 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:01.215693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:01.215711 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:59:01.215840 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.215847 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.216684 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.216690 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.217512 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.217522 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.218195 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.218199 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.218301 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.218333 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 05:59:01.218443 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 05:59:01.218536 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 05:59:01.218678 24801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.215315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:33389 (local address 127.2.191.66:33281)
0808 05:59:01.215438 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:01.215442 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:01.215460 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:59:01.215528 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:01.215531 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:01.215583 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:01.215678 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:59:01.215970 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.216564 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.217644 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.218057 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.218195 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.218250 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:01.218474 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 05:59:01.218567 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:59:01.219388 24800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.215247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.2.191.67:60445 (local address 127.2.191.65:46399)
0808 05:59:01.215400 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:01.215406 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:01.215796 (+ 390us) server_negotiation.cc:407] Connection header received
0808 05:59:01.215954 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:01.215957 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:01.216016 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:01.216098 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:59:01.216413 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.216996 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.218011 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.218510 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.218655 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.218721 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:01.219132 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 05:59:01.219239 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 05:59:01.219760 24811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.215128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:46399 (local address 127.2.191.67:60445)
0808 05:59:01.215693 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:01.215706 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:01.215837 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:01.216151 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:01.216154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:01.216173 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:59:01.216291 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.216296 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.217114 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.217117 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.217880 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:01.217888 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.218818 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.218823 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:01.218953 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.218988 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 05:59:01.219569 (+ 581us) client_negotiation.cc:240] Negotiation successful
0808 05:59:01.219647 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"mutex_wait_us":177,"thread_start_us":168,"threads_started":1}
I20260808 05:59:01.219739 24596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "428a15781645450a8f5aa634de0ff382" candidate_uuid: "b675a857965044c39cc4c3d4668a3ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29af1a6d7cc4437b860a24210029f459" is_pre_election: true
I20260808 05:59:01.220127 24596 raft_consensus.cc:2454] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675a857965044c39cc4c3d4668a3ee5 in term 0.
I20260808 05:59:01.220669 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "428a15781645450a8f5aa634de0ff382" candidate_uuid: "b675a857965044c39cc4c3d4668a3ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8609401b164a4797991e5ac846b5d5" is_pre_election: true
I20260808 05:59:01.220679 24670 leader_election.cc:302] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 29af1a6d7cc4437b860a24210029f459, b675a857965044c39cc4c3d4668a3ee5; no voters:
I20260808 05:59:01.221010 24809 raft_consensus.cc:2781] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:59:01.221026 24455 raft_consensus.cc:2454] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675a857965044c39cc4c3d4668a3ee5 in term 0.
I20260808 05:59:01.221127 24809 raft_consensus.cc:482] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:59:01.221228 24809 raft_consensus.cc:3037] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:01.222582 24809 raft_consensus.cc:504] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.222997 24809 leader_election.cc:288] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [CANDIDATE]: Term 1 election: Requested vote from peers 29af1a6d7cc4437b860a24210029f459 (127.2.191.66:33281), 5c8609401b164a4797991e5ac846b5d5 (127.2.191.65:46399)
I20260808 05:59:01.223383 24455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "428a15781645450a8f5aa634de0ff382" candidate_uuid: "b675a857965044c39cc4c3d4668a3ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8609401b164a4797991e5ac846b5d5"
I20260808 05:59:01.223394 24596 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "428a15781645450a8f5aa634de0ff382" candidate_uuid: "b675a857965044c39cc4c3d4668a3ee5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "29af1a6d7cc4437b860a24210029f459"
I20260808 05:59:01.223522 24455 raft_consensus.cc:3037] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:01.223522 24596 raft_consensus.cc:3037] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:01.224944 24596 raft_consensus.cc:2454] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675a857965044c39cc4c3d4668a3ee5 in term 1.
I20260808 05:59:01.224944 24455 raft_consensus.cc:2454] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675a857965044c39cc4c3d4668a3ee5 in term 1.
I20260808 05:59:01.225294 24669 leader_election.cc:302] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8609401b164a4797991e5ac846b5d5, b675a857965044c39cc4c3d4668a3ee5; no voters:
I20260808 05:59:01.225479 24809 raft_consensus.cc:2781] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:01.225740 24809 raft_consensus.cc:686] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 1 LEADER]: Becoming Leader. State: Replica: b675a857965044c39cc4c3d4668a3ee5, State: Running, Role: LEADER
I20260808 05:59:01.226147 24809 consensus_queue.cc:237] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } }
I20260808 05:59:01.229662 24307 catalog_manager.cc:5495] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b675a857965044c39cc4c3d4668a3ee5 (127.2.191.67). New cstate: current_term: 1 leader_uuid: "b675a857965044c39cc4c3d4668a3ee5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b675a857965044c39cc4c3d4668a3ee5" member_type: VOTER last_known_addr { host: "127.2.191.67" port: 44127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 } health_report { overall_health: UNKNOWN } } }
I20260808 05:59:01.260015 24797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.256263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37232 (local address 127.2.191.67:44127)
0808 05:59:01.256443 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:01.256447 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:01.256459 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:59:01.256539 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:01.256541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:01.256601 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:01.256720 (+ 119us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:01.257008 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.257519 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.258461 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:01.258693 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:01.258809 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:01.259143 (+ 334us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:01.259584 (+ 441us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:01.259735 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:01.259800 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 05:59:01.259858 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 05:59:01.266240 24455 raft_consensus.cc:1261] T 428a15781645450a8f5aa634de0ff382 P 5c8609401b164a4797991e5ac846b5d5 [term 1 FOLLOWER]: Refusing update from remote peer b675a857965044c39cc4c3d4668a3ee5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:59:01.266240 24596 raft_consensus.cc:1261] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 1 FOLLOWER]: Refusing update from remote peer b675a857965044c39cc4c3d4668a3ee5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:59:01.267047 24812 consensus_queue.cc:1035] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8609401b164a4797991e5ac846b5d5" member_type: VOTER last_known_addr { host: "127.2.191.65" port: 46399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:59:01.267309 24809 consensus_queue.cc:1035] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "29af1a6d7cc4437b860a24210029f459" member_type: VOTER last_known_addr { host: "127.2.191.66" port: 33281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:59:01.276248 24817 mvcc.cc:205] Tried to move back new op lower bound from 7316147164218748928 to 7316147164065648640. Current Snapshot: MvccSnapshot[applied={T|T < 7316147164218748928}]
I20260808 05:59:01.278604 24816 mvcc.cc:205] Tried to move back new op lower bound from 7316147164218748928 to 7316147164065648640. Current Snapshot: MvccSnapshot[applied={T|T < 7316147164218748928 or (T in {7316147164218748928})}]
I20260808 05:59:01.284909 24306 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:59:01.285070 24306 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57792:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:59:01.287724 24306 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5daf25099f04ba68e0a24279aa489ce: Sending DeleteTablet for 3 replicas of tablet 428a15781645450a8f5aa634de0ff382
I20260808 05:59:01.288620 24575 tablet_service.cc:1514] Processing DeleteTablet for tablet 428a15781645450a8f5aa634de0ff382 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:59:01 UTC) from {username='slave'} at 127.0.0.1:55602
I20260808 05:59:01.288636 24714 tablet_service.cc:1514] Processing DeleteTablet for tablet 428a15781645450a8f5aa634de0ff382 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:59:01 UTC) from {username='slave'} at 127.0.0.1:37220
I20260808 05:59:01.288946 24435 tablet_service.cc:1514] Processing DeleteTablet for tablet 428a15781645450a8f5aa634de0ff382 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:59:01 UTC) from {username='slave'} at 127.0.0.1:42938
I20260808 05:59:01.289361 24826 tablet_replica.cc:330] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: stopping tablet replica
I20260808 05:59:01.289697 24826 raft_consensus.cc:2229] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:59:01.289908 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 24369
I20260808 05:59:01.291815 24826 raft_consensus.cc:2258] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:59:01.293435 24826 ts_tablet_manager.cc:1905] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:59:01.295714 24826 ts_tablet_manager.cc:1918] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:59:01.295842 24826 log.cc:1196] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-2/wal/wals/428a15781645450a8f5aa634de0ff382
I20260808 05:59:01.296159 24826 ts_tablet_manager.cc:1939] T 428a15781645450a8f5aa634de0ff382 P b675a857965044c39cc4c3d4668a3ee5: Deleting consensus metadata
I20260808 05:59:01.297482 24827 tablet_replica.cc:330] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: stopping tablet replica
I20260808 05:59:01.297446 24294 catalog_manager.cc:4841] TS b675a857965044c39cc4c3d4668a3ee5 (127.2.191.67:44127): tablet 428a15781645450a8f5aa634de0ff382 (table test-table [id=6fe5bcfed2ce4a0986f83c60b7b483f1]) successfully deleted
I20260808 05:59:01.297838 24827 raft_consensus.cc:2229] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:59:01.298173 24827 raft_consensus.cc:2258] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:59:01.299641 24827 ts_tablet_manager.cc:1905] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:59:01.301915 24827 ts_tablet_manager.cc:1918] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:59:01.302042 24827 log.cc:1196] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: Deleting WAL directory at /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786168478015505-2813-0/minicluster-data/ts-1/wal/wals/428a15781645450a8f5aa634de0ff382
I20260808 05:59:01.302387 24827 ts_tablet_manager.cc:1939] T 428a15781645450a8f5aa634de0ff382 P 29af1a6d7cc4437b860a24210029f459: Deleting consensus metadata
W20260808 05:59:01.302510 24293 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.2.191.65:46399 (error 108)
I20260808 05:59:01.302700 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 24510
I20260808 05:59:01.305325 24796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.304778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.65:46399 (local address 127.0.0.1:42954)
0808 05:59:01.305144 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:01.305223 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.65:46399: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":261}
W20260808 05:59:01.305686 24293 catalog_manager.cc:4584] TS 5c8609401b164a4797991e5ac846b5d5 (127.2.191.65:46399): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 428a15781645450a8f5aa634de0ff382: Network error: Client connection negotiation failed: client connection to 127.2.191.65:46399: connect: Connection refused (error 111)
I20260808 05:59:01.314380 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 24650
I20260808 05:59:01.314606 24796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:01.314257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.66:33281 (local address 127.0.0.1:55618)
0808 05:59:01.314419 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:01.314493 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.66:33281: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 05:59:01.323612 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 24276
2026-08-08T05:59:01Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (1140 ms)
[----------] 6 tests from EncryptionPolicyTest (11386 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:01 dist-test-slave-qg60 krb5kdc[24832](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:01 dist-test-slave-qg60 krb5kdc[24832](info): set up 2 sockets
Aug 08 05:59:01 dist-test-slave-qg60 krb5kdc[24832](info): commencing operation
krb5kdc: starting...
W20260808 05:59:02.424142 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:02 dist-test-slave-qg60 krb5kdc[24832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:02.565405 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36045
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41403
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36045
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:02.681886 24845 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:02.682217 24845 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:02.682309 24845 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:02.686374 24845 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:02.686478 24845 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:02.686519 24845 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:02.686558 24845 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:02.686594 24845 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:02.691995 24845 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41403
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36045
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36045
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24845
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:02.693209 24845 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:02.694273 24845 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:02.703135 24851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:02.703177 24850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:02.703323 24845 server_base.cc:1034] running on GCE node
W20260808 05:59:02.703094 24853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:02.704083 24845 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:02.705338 24845 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:02.706526 24845 hybrid_clock.cc:648] HybridClock initialized: now 1786168742706494 us; error 48 us; skew 500 ppm
Aug 08 05:59:02 dist-test-slave-qg60 krb5kdc[24832](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168742, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:02.714785 24845 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:02.715749 24845 webserver.cc:460] Webserver started at http://127.0.0.1:44825/ using document root <none> and password file <none>
I20260808 05:59:02.716356 24845 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:02.716454 24845 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:02.716694 24845 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:02.718796 24845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "2fc2b4ced05c4cff8598b465f103627f"
format_stamp: "Formatted at 2026-08-08 05:59:02 on dist-test-slave-qg60"
server_key: "635ca648d49da5f5d91ef11b3a3ace88"
server_key_iv: "45ae225e4d6a981af27cbcdb4298e4fd"
server_key_version: "encryptionkey@0"
I20260808 05:59:02.719383 24845 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "2fc2b4ced05c4cff8598b465f103627f"
format_stamp: "Formatted at 2026-08-08 05:59:02 on dist-test-slave-qg60"
server_key: "635ca648d49da5f5d91ef11b3a3ace88"
server_key_iv: "45ae225e4d6a981af27cbcdb4298e4fd"
server_key_version: "encryptionkey@0"
I20260808 05:59:02.723378 24845 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.005s
I20260808 05:59:02.725875 24860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:02.727196 24845 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:59:02.727356 24845 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "2fc2b4ced05c4cff8598b465f103627f"
format_stamp: "Formatted at 2026-08-08 05:59:02 on dist-test-slave-qg60"
server_key: "635ca648d49da5f5d91ef11b3a3ace88"
server_key_iv: "45ae225e4d6a981af27cbcdb4298e4fd"
server_key_version: "encryptionkey@0"
I20260808 05:59:02.727480 24845 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:02.738206 24845 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:02.741547 24845 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:02.741763 24845 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:02.751564 24845 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36045
I20260808 05:59:02.751592 24917 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36045 every 8 connection(s)
I20260808 05:59:02.752532 24845 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:02.753523 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 24845
I20260808 05:59:02.753697 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:02.754076 2813 external_mini_cluster.cc:1428] Setting key 49768c62feb78fdff334db311010e4a2
I20260808 05:59:02.757182 24918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 08 05:59:02 dist-test-slave-qg60 krb5kdc[24832](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168742, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:59:02.763341 24918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f: Bootstrap starting.
I20260808 05:59:02.766515 24918 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:02.767565 24918 log.cc:824] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:02.770148 24921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:02.755672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38893 (local address 127.0.0.1:36045)
0808 05:59:02.756121 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:02.756136 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:02.756174 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:59:02.756917 (+ 743us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:02.756935 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:02.757361 (+ 426us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:02.757714 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:02.758581 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:02.759609 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:02.760487 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:02.761008 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:02.761184 (+ 176us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:02.763869 (+ 2685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:02.763876 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:02.763893 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:02.763937 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:02.766173 (+ 2236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:02.766865 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:02.766876 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:02.766882 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:02.767047 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:02.767411 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:02.767415 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:02.767417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:02.767997 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:02.768203 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:02.768713 (+ 510us) server_negotiation.cc:299] Negotiation successful
0808 05:59:02.769111 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":154,"threads_started":1}
I20260808 05:59:02.770256 24918 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f: No bootstrap required, opened a new log
I20260808 05:59:02.773666 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:02.776786 24918 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc2b4ced05c4cff8598b465f103627f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36045 } }
I20260808 05:59:02.777175 24918 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:02.777272 24918 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fc2b4ced05c4cff8598b465f103627f, State: Initialized, Role: FOLLOWER
I20260808 05:59:02.777858 24918 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc2b4ced05c4cff8598b465f103627f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36045 } }
I20260808 05:59:02.778031 24918 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:02.778132 24918 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:02.778244 24918 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:02.779594 24918 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc2b4ced05c4cff8598b465f103627f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36045 } }
I20260808 05:59:02.780030 24918 leader_election.cc:302] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fc2b4ced05c4cff8598b465f103627f; no voters:
I20260808 05:59:02.780476 24918 leader_election.cc:288] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:02.780584 24928 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:02.780913 24928 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [term 1 LEADER]: Becoming Leader. State: Replica: 2fc2b4ced05c4cff8598b465f103627f, State: Running, Role: LEADER
I20260808 05:59:02.781340 24928 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc2b4ced05c4cff8598b465f103627f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36045 } }
I20260808 05:59:02.781958 24918 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:02.783967 24929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fc2b4ced05c4cff8598b465f103627f. Latest consensus state: current_term: 1 leader_uuid: "2fc2b4ced05c4cff8598b465f103627f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc2b4ced05c4cff8598b465f103627f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36045 } } }
I20260808 05:59:02.783967 24930 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fc2b4ced05c4cff8598b465f103627f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fc2b4ced05c4cff8598b465f103627f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36045 } } }
I20260808 05:59:02.784301 24929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:02.784308 24930 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:02.786530 24921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:02.776276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60637 (local address 127.0.0.1:36045)
0808 05:59:02.776416 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:02.776427 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:02.776595 (+ 168us) server_negotiation.cc:407] Connection header received
0808 05:59:02.776775 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:02.776784 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:02.776829 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:02.776897 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:02.777855 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:02.778575 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:02.779845 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:02.780247 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:02.780389 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:02.782258 (+ 1869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:02.782263 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:02.782266 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:02.782294 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:02.784189 (+ 1895us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:02.784874 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:02.784880 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:02.784884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:02.784975 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:02.785421 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:02.785425 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:02.785427 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:02.785683 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:02.785835 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:02.786266 (+ 431us) server_negotiation.cc:299] Negotiation successful
0808 05:59:02.786349 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
W20260808 05:59:02.788183 24944 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:02.788280 24944 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:02.788643 24945 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:02.789462 24945 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:02.795385 24945 catalog_manager.cc:1347] Generated new cluster ID: 43512fb82d6f41e6ba7800c159161de0
I20260808 05:59:02.795460 24945 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:02.803148 24945 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:02.804454 24945 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:02.818208 24945 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fc2b4ced05c4cff8598b465f103627f: Generated new TSK 0
I20260808 05:59:02.819027 24945 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:02.828044 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 24845
W20260808 05:59:02.837020 24830 connection.cc:535] client connection to 127.0.0.1:36045 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36045): Connection reset by peer (error 104)
2026-08-08T05:59:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1503 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:02 dist-test-slave-qg60 krb5kdc[24951](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:02 dist-test-slave-qg60 krb5kdc[24951](info): set up 2 sockets
Aug 08 05:59:02 dist-test-slave-qg60 krb5kdc[24951](info): commencing operation
krb5kdc: starting...
W20260808 05:59:03.985574 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:04 dist-test-slave-qg60 krb5kdc[24951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:04.129627 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34303
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38033
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34303
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:04.250765 24964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:04.251130 24964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:04.251214 24964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:04.255548 24964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:04.255649 24964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:04.255688 24964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:04.255746 24964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:04.255786 24964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:04.261330 24964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38033
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34303
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:04.262457 24964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:04.263505 24964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:04.272341 24969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:04.272356 24972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:04.272625 24964 server_base.cc:1034] running on GCE node
W20260808 05:59:04.272349 24970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:04.273375 24964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:04.274711 24964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:04.275919 24964 hybrid_clock.cc:648] HybridClock initialized: now 1786168744275900 us; error 34 us; skew 500 ppm
Aug 08 05:59:04 dist-test-slave-qg60 krb5kdc[24951](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:04.279063 24964 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:04.279979 24964 webserver.cc:460] Webserver started at http://127.0.0.1:36147/ using document root <none> and password file <none>
I20260808 05:59:04.280563 24964 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:04.280658 24964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:04.280921 24964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:04.282996 24964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "26588144db9b4bbbb16b082d0d6f5f16"
format_stamp: "Formatted at 2026-08-08 05:59:04 on dist-test-slave-qg60"
server_key: "147fe4be6b8fcd49b382627b1acc678c"
server_key_iv: "22d10d6e58b0801c47cb6626d8b6457f"
server_key_version: "encryptionkey@0"
I20260808 05:59:04.283582 24964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "26588144db9b4bbbb16b082d0d6f5f16"
format_stamp: "Formatted at 2026-08-08 05:59:04 on dist-test-slave-qg60"
server_key: "147fe4be6b8fcd49b382627b1acc678c"
server_key_iv: "22d10d6e58b0801c47cb6626d8b6457f"
server_key_version: "encryptionkey@0"
I20260808 05:59:04.287537 24964 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s
I20260808 05:59:04.290216 24980 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:04.291623 24964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:59:04.291791 24964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "26588144db9b4bbbb16b082d0d6f5f16"
format_stamp: "Formatted at 2026-08-08 05:59:04 on dist-test-slave-qg60"
server_key: "147fe4be6b8fcd49b382627b1acc678c"
server_key_iv: "22d10d6e58b0801c47cb6626d8b6457f"
server_key_version: "encryptionkey@0"
I20260808 05:59:04.291929 24964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:04.305383 24964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:04.308876 24964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:04.309113 24964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:04.316589 24964 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34303
I20260808 05:59:04.316617 25035 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34303 every 8 connection(s)
I20260808 05:59:04.317714 24964 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:04.320582 25036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:04.326524 25036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16: Bootstrap starting.
I20260808 05:59:04.327869 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 24964
I20260808 05:59:04.328011 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:04.328332 2813 external_mini_cluster.cc:1428] Setting key 3e55ce9441a5e76399a8485130e64da6
I20260808 05:59:04.329399 25036 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:04.330271 25036 log.cc:824] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:04.332643 25036 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16: No bootstrap required, opened a new log
I20260808 05:59:04.336959 25036 raft_consensus.cc:348] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26588144db9b4bbbb16b082d0d6f5f16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } }
I20260808 05:59:04.337239 25036 raft_consensus.cc:374] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:04.337311 25036 raft_consensus.cc:729] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26588144db9b4bbbb16b082d0d6f5f16, State: Initialized, Role: FOLLOWER
I20260808 05:59:04.337846 25036 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26588144db9b4bbbb16b082d0d6f5f16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } }
I20260808 05:59:04.338007 25036 raft_consensus.cc:388] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:04.338066 25036 raft_consensus.cc:482] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:04.338160 25036 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:04.338969 25039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:04.329623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40459 (local address 127.0.0.1:34303)
0808 05:59:04.330142 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:04.330164 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:04.330207 (+ 43us) server_negotiation.cc:407] Connection header received
0808 05:59:04.331045 (+ 838us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:04.331095 (+ 50us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:04.331540 (+ 445us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:04.331906 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:04.332341 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:04.333783 (+ 1442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:04.334711 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:04.335483 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:04.335683 (+ 200us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:04.336586 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:04.336592 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:04.336607 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:04.337143 (+ 536us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:04.337213 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:04.337248 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:04.337386 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:04.337807 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 05:59:04.337951 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":149,"threads_started":1}
I20260808 05:59:04.339356 25036 raft_consensus.cc:504] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26588144db9b4bbbb16b082d0d6f5f16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } }
I20260808 05:59:04.339722 25036 leader_election.cc:302] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26588144db9b4bbbb16b082d0d6f5f16; no voters:
I20260808 05:59:04.340056 25036 leader_election.cc:288] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:04.340185 25041 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:04.340375 25041 raft_consensus.cc:686] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [term 1 LEADER]: Becoming Leader. State: Replica: 26588144db9b4bbbb16b082d0d6f5f16, State: Running, Role: LEADER
I20260808 05:59:04.340657 25041 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26588144db9b4bbbb16b082d0d6f5f16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } }
I20260808 05:59:04.341398 25036 sys_catalog.cc:564] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:04.342303 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:04.342494 25043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26588144db9b4bbbb16b082d0d6f5f16. Latest consensus state: current_term: 1 leader_uuid: "26588144db9b4bbbb16b082d0d6f5f16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26588144db9b4bbbb16b082d0d6f5f16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } } }
I20260808 05:59:04.342686 25043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:04.344353 25042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26588144db9b4bbbb16b082d0d6f5f16" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26588144db9b4bbbb16b082d0d6f5f16" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34303 } } }
I20260808 05:59:04.344448 25042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:04.344214 25050 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:04.347604 25050 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:04.349843 25039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:04.345190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43563 (local address 127.0.0.1:34303)
0808 05:59:04.345314 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:04.345317 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:04.345548 (+ 231us) server_negotiation.cc:407] Connection header received
0808 05:59:04.345654 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:04.345657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:04.345706 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:04.345796 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:04.346179 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:04.346924 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:04.347879 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:04.348211 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:04.348326 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:04.349313 (+ 987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:04.349317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:04.349319 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:04.349332 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:04.349367 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:04.349379 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:04.349493 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:04.349644 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 05:59:04.349681 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:59:04.353708 25050 catalog_manager.cc:1347] Generated new cluster ID: bc734e2d298e464585ed7c10bc8426da
I20260808 05:59:04.353780 25050 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:04.366463 25050 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:04.367411 25050 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:04.376452 25050 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 26588144db9b4bbbb16b082d0d6f5f16: Generated new TSK 0
I20260808 05:59:04.377241 25050 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:04.381358 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 24964
W20260808 05:59:04.390772 24949 connection.cc:535] client connection to 127.0.0.1:34303 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34303): Connection reset by peer (error 104)
2026-08-08T05:59:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1553 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:04 dist-test-slave-qg60 krb5kdc[25068](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:04 dist-test-slave-qg60 krb5kdc[25068](info): set up 2 sockets
Aug 08 05:59:04 dist-test-slave-qg60 krb5kdc[25068](info): commencing operation
krb5kdc: starting...
W20260808 05:59:05.497812 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:05 dist-test-slave-qg60 krb5kdc[25068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:05.640667 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36127
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36127
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:05.757928 25081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:05.758232 25081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:05.758314 25081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:05.762450 25081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:05.762542 25081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:05.762580 25081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:05.762638 25081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:05.762678 25081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:05.768111 25081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36127
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36127
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:05.769322 25081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:05.770511 25081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:05.779743 25088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:05.779774 25089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:05.779906 25081 server_base.cc:1034] running on GCE node
W20260808 05:59:05.779912 25091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:05.780787 25081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:05.782004 25081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:05.783202 25081 hybrid_clock.cc:648] HybridClock initialized: now 1786168745783193 us; error 30 us; skew 500 ppm
Aug 08 05:59:05 dist-test-slave-qg60 krb5kdc[25068](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168745, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:05.786257 25081 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:05.787245 25081 webserver.cc:460] Webserver started at http://127.0.0.1:45049/ using document root <none> and password file <none>
I20260808 05:59:05.787824 25081 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:05.787920 25081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:05.788161 25081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:05.790335 25081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "4b33bebc1399419689593697c2f2f073"
format_stamp: "Formatted at 2026-08-08 05:59:05 on dist-test-slave-qg60"
server_key: "70dd409c298ca4270d0a3a8d1fb5996f"
server_key_iv: "b65e213ca23d0d1cdc204c92f75ac83e"
server_key_version: "encryptionkey@0"
I20260808 05:59:05.790963 25081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "4b33bebc1399419689593697c2f2f073"
format_stamp: "Formatted at 2026-08-08 05:59:05 on dist-test-slave-qg60"
server_key: "70dd409c298ca4270d0a3a8d1fb5996f"
server_key_iv: "b65e213ca23d0d1cdc204c92f75ac83e"
server_key_version: "encryptionkey@0"
I20260808 05:59:05.794956 25081 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:05.797546 25098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:05.798944 25081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:05.799108 25081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "4b33bebc1399419689593697c2f2f073"
format_stamp: "Formatted at 2026-08-08 05:59:05 on dist-test-slave-qg60"
server_key: "70dd409c298ca4270d0a3a8d1fb5996f"
server_key_iv: "b65e213ca23d0d1cdc204c92f75ac83e"
server_key_version: "encryptionkey@0"
I20260808 05:59:05.799238 25081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:05.804201 25081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:05.807582 25081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:05.807794 25081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:05.815358 25081 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36127
I20260808 05:59:05.815385 25155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36127 every 8 connection(s)
I20260808 05:59:05.816320 25081 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:05.818650 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 25081
I20260808 05:59:05.818826 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:05.819164 2813 external_mini_cluster.cc:1428] Setting key 5af76ab603a68e0d272010a7359fb345
I20260808 05:59:05.819427 25156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:05.825094 25159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:05.820695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54633 (local address 127.0.0.1:36127)
0808 05:59:05.821213 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:05.821229 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:05.821267 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:59:05.822294 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:05.822314 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:05.822605 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:05.822955 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:05.823793 (+ 838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:05.823797 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:05.823809 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:05.823819 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:05.823874 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:05.823893 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:05.824047 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:05.824123 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 05:59:05.824283 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":164,"threads_started":1}
I20260808 05:59:05.826325 25156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073: Bootstrap starting.
I20260808 05:59:05.828012 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:05.828841 25156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:05.829728 25156 log.cc:824] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:05.831980 25159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:05.830369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60059 (local address 127.0.0.1:36127)
0808 05:59:05.830511 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:05.830516 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:05.830674 (+ 158us) server_negotiation.cc:407] Connection header received
0808 05:59:05.830789 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:05.830791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:05.830820 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:05.830888 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:05.831604 (+ 716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:05.831607 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:05.831609 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:05.831619 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:05.831643 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:05.831652 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:05.831722 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:05.831833 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 05:59:05.831861 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:59:05.832319 25156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073: No bootstrap required, opened a new log
I20260808 05:59:05.835958 25156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b33bebc1399419689593697c2f2f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36127 } }
I20260808 05:59:05.836232 25156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:05.836308 25156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b33bebc1399419689593697c2f2f073, State: Initialized, Role: FOLLOWER
I20260808 05:59:05.836810 25156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b33bebc1399419689593697c2f2f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36127 } }
I20260808 05:59:05.836979 25156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:05.837050 25156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:05.837152 25156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:05.838186 25156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b33bebc1399419689593697c2f2f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36127 } }
I20260808 05:59:05.838553 25156 leader_election.cc:302] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b33bebc1399419689593697c2f2f073; no voters:
I20260808 05:59:05.838930 25156 leader_election.cc:288] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:05.839205 25168 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:05.839424 25168 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [term 1 LEADER]: Becoming Leader. State: Replica: 4b33bebc1399419689593697c2f2f073, State: Running, Role: LEADER
I20260808 05:59:05.839740 25168 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b33bebc1399419689593697c2f2f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36127 } }
I20260808 05:59:05.840258 25156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:05.841531 25169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b33bebc1399419689593697c2f2f073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b33bebc1399419689593697c2f2f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36127 } } }
I20260808 05:59:05.841698 25169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:05.841990 25170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b33bebc1399419689593697c2f2f073. Latest consensus state: current_term: 1 leader_uuid: "4b33bebc1399419689593697c2f2f073" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b33bebc1399419689593697c2f2f073" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36127 } } }
I20260808 05:59:05.842132 25170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:05.842108 25177 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:05.845513 25177 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:05.851444 25177 catalog_manager.cc:1347] Generated new cluster ID: 2bbdbe966ada4e88a73ca65c2fa596d7
I20260808 05:59:05.851526 25177 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:05.868185 25177 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:05.868562 25177 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:05.876649 25177 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b33bebc1399419689593697c2f2f073: Generated new TSK 0
I20260808 05:59:05.877414 25177 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:05.886866 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 25081
2026-08-08T05:59:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1504 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:05 dist-test-slave-qg60 krb5kdc[25190](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:05 dist-test-slave-qg60 krb5kdc[25190](info): set up 2 sockets
Aug 08 05:59:05 dist-test-slave-qg60 krb5kdc[25190](info): commencing operation
krb5kdc: starting...
W20260808 05:59:06.997128 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:07 dist-test-slave-qg60 krb5kdc[25190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:07.135872 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35691
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36305
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35691
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:07.254921 25203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:07.255218 25203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:07.255260 25203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:07.259361 25203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:07.259425 25203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:07.259445 25203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:07.259462 25203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:07.259477 25203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:07.265219 25203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36305
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35691
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35691
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:07.266326 25203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:07.267395 25203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:07.276302 25210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:07.276471 25203 server_base.cc:1034] running on GCE node
W20260808 05:59:07.276302 25209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:07.276307 25212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:07.277128 25203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:07.278339 25203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:07.279574 25203 hybrid_clock.cc:648] HybridClock initialized: now 1786168747279546 us; error 44 us; skew 500 ppm
Aug 08 05:59:07 dist-test-slave-qg60 krb5kdc[25190](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168747, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:07.282774 25203 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:07.284009 25203 webserver.cc:460] Webserver started at http://127.0.0.1:35371/ using document root <none> and password file <none>
I20260808 05:59:07.284543 25203 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:07.284605 25203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:07.284865 25203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:07.287002 25203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "0f5cd52d5dbc47408b4e6f01f669310c"
format_stamp: "Formatted at 2026-08-08 05:59:07 on dist-test-slave-qg60"
server_key: "61d077003cdc2ebffc7b18c7555f492e"
server_key_iv: "2afe063640e30a1398ff375f4c4cb146"
server_key_version: "encryptionkey@0"
I20260808 05:59:07.287532 25203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "0f5cd52d5dbc47408b4e6f01f669310c"
format_stamp: "Formatted at 2026-08-08 05:59:07 on dist-test-slave-qg60"
server_key: "61d077003cdc2ebffc7b18c7555f492e"
server_key_iv: "2afe063640e30a1398ff375f4c4cb146"
server_key_version: "encryptionkey@0"
I20260808 05:59:07.291483 25203 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:59:07.294098 25219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:07.295476 25203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:59:07.295636 25203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "0f5cd52d5dbc47408b4e6f01f669310c"
format_stamp: "Formatted at 2026-08-08 05:59:07 on dist-test-slave-qg60"
server_key: "61d077003cdc2ebffc7b18c7555f492e"
server_key_iv: "2afe063640e30a1398ff375f4c4cb146"
server_key_version: "encryptionkey@0"
I20260808 05:59:07.295769 25203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:07.338394 25203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:07.341987 25203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:07.342249 25203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:07.350795 25203 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35691
I20260808 05:59:07.350821 25272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35691 every 8 connection(s)
I20260808 05:59:07.351881 25203 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:07.354048 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 25203
I20260808 05:59:07.354243 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:07.354578 2813 external_mini_cluster.cc:1428] Setting key 4bfa5d2a16f60495d65132ed7f756304
I20260808 05:59:07.354986 25273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:07.362542 25273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c: Bootstrap starting.
Aug 08 05:59:07 dist-test-slave-qg60 krb5kdc[25190](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:59:07.365163 25273 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:07.366096 25273 log.cc:824] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:07.368124 25273 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c: No bootstrap required, opened a new log
I20260808 05:59:07.370780 25276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:07.356187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39789 (local address 127.0.0.1:35691)
0808 05:59:07.356646 (+ 459us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:07.356665 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:07.356708 (+ 43us) server_negotiation.cc:407] Connection header received
0808 05:59:07.357789 (+ 1081us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:07.357814 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:07.358268 (+ 454us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:07.358650 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:07.359414 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:07.360971 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:07.361933 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:07.362621 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:07.362788 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:07.365695 (+ 2907us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:07.365702 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:07.365720 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:07.365755 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:07.367725 (+ 1970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:07.368336 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:07.368341 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:07.368346 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:07.368462 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:07.368798 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:07.368802 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:07.368803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:07.369233 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:07.369445 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:07.369753 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 05:59:07.370066 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":306,"thread_start_us":136,"threads_started":1}
I20260808 05:59:07.371938 25273 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f5cd52d5dbc47408b4e6f01f669310c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35691 } }
I20260808 05:59:07.372154 25273 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:07.372226 25273 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f5cd52d5dbc47408b4e6f01f669310c, State: Initialized, Role: FOLLOWER
I20260808 05:59:07.372798 25273 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f5cd52d5dbc47408b4e6f01f669310c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35691 } }
I20260808 05:59:07.372959 25273 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:07.373028 25273 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:07.373139 25273 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:07.373778 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:07.374258 25273 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f5cd52d5dbc47408b4e6f01f669310c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35691 } }
I20260808 05:59:07.374595 25273 leader_election.cc:302] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f5cd52d5dbc47408b4e6f01f669310c; no voters:
I20260808 05:59:07.374938 25273 leader_election.cc:288] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:07.375022 25278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:07.375239 25278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [term 1 LEADER]: Becoming Leader. State: Replica: 0f5cd52d5dbc47408b4e6f01f669310c, State: Running, Role: LEADER
I20260808 05:59:07.375530 25278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f5cd52d5dbc47408b4e6f01f669310c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35691 } }
I20260808 05:59:07.376255 25273 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:07.377168 25282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f5cd52d5dbc47408b4e6f01f669310c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f5cd52d5dbc47408b4e6f01f669310c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35691 } } }
I20260808 05:59:07.377326 25282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:07.377562 25282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f5cd52d5dbc47408b4e6f01f669310c. Latest consensus state: current_term: 1 leader_uuid: "0f5cd52d5dbc47408b4e6f01f669310c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f5cd52d5dbc47408b4e6f01f669310c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35691 } } }
I20260808 05:59:07.377655 25282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:07.378808 25293 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:07.381928 25293 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:07.385982 25276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:07.376096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36487 (local address 127.0.0.1:35691)
0808 05:59:07.376200 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:07.376203 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:07.376799 (+ 596us) server_negotiation.cc:407] Connection header received
0808 05:59:07.377004 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:07.377008 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:07.377059 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:07.377111 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:07.378307 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:07.379153 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:07.379955 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:07.380295 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:07.380405 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:07.382139 (+ 1734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:07.382143 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:07.382146 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:07.382173 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:07.384008 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:07.384552 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:07.384555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:07.384557 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:07.384651 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:07.385004 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:07.385009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:07.385010 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:07.385231 (+ 221us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:07.385376 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:07.385676 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 05:59:07.385803 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:59:07.387323 25293 catalog_manager.cc:1347] Generated new cluster ID: b9cafebc13de4ea0b30d77e02b07eed2
I20260808 05:59:07.387390 25293 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:07.398518 25293 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:07.399557 25293 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:07.406641 25293 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f5cd52d5dbc47408b4e6f01f669310c: Generated new TSK 0
I20260808 05:59:07.407342 25293 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:07.415846 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 25203
2026-08-08T05:59:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1529 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:07 dist-test-slave-qg60 krb5kdc[25306](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:07 dist-test-slave-qg60 krb5kdc[25306](info): set up 2 sockets
Aug 08 05:59:07 dist-test-slave-qg60 krb5kdc[25306](info): commencing operation
krb5kdc: starting...
W20260808 05:59:08.545285 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:08 dist-test-slave-qg60 krb5kdc[25306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168748, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:08.683947 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37641
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:08.803110 25319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:08.803448 25319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:08.803576 25319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:08.807863 25319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:08.807982 25319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:08.808022 25319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:08.808084 25319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:08.808120 25319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:08.813777 25319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25319
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:08.814965 25319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:08.816080 25319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:08.825039 25326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:08.825194 25325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:08.825210 25328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:08.825258 25319 server_base.cc:1034] running on GCE node
I20260808 05:59:08.826051 25319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:08.827260 25319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:08.828469 25319 hybrid_clock.cc:648] HybridClock initialized: now 1786168748828452 us; error 31 us; skew 500 ppm
Aug 08 05:59:08 dist-test-slave-qg60 krb5kdc[25306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168748, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:08.837492 25319 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:08.838639 25319 webserver.cc:460] Webserver started at http://127.0.0.1:41351/ using document root <none> and password file <none>
I20260808 05:59:08.839263 25319 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:08.839365 25319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:08.839624 25319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:08.841982 25319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "e6a3f15d6e384a0888634eab90ce028e"
format_stamp: "Formatted at 2026-08-08 05:59:08 on dist-test-slave-qg60"
server_key: "fc726d561399be9bc0933c89c5696bf3"
server_key_iv: "f9c7ab1eedbc0c58f0f944706355cdfe"
server_key_version: "encryptionkey@0"
I20260808 05:59:08.842577 25319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "e6a3f15d6e384a0888634eab90ce028e"
format_stamp: "Formatted at 2026-08-08 05:59:08 on dist-test-slave-qg60"
server_key: "fc726d561399be9bc0933c89c5696bf3"
server_key_iv: "f9c7ab1eedbc0c58f0f944706355cdfe"
server_key_version: "encryptionkey@0"
I20260808 05:59:08.846752 25319 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:08.849705 25335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:08.851244 25319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:08.851403 25319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "e6a3f15d6e384a0888634eab90ce028e"
format_stamp: "Formatted at 2026-08-08 05:59:08 on dist-test-slave-qg60"
server_key: "fc726d561399be9bc0933c89c5696bf3"
server_key_iv: "f9c7ab1eedbc0c58f0f944706355cdfe"
server_key_version: "encryptionkey@0"
I20260808 05:59:08.851539 25319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:08.875252 25319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:08.878526 25319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:08.878782 25319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:08.886528 25319 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37641
I20260808 05:59:08.886569 25387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37641 every 8 connection(s)
I20260808 05:59:08.887537 25319 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:08.890477 25388 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:08.892062 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 25319
I20260808 05:59:08.892227 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:08.892511 2813 external_mini_cluster.cc:1428] Setting key d658477c39b394b1eab916a3ef4341d9
I20260808 05:59:08.897621 25388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e: Bootstrap starting.
I20260808 05:59:08.900429 25388 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:08.901463 25388 log.cc:824] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:08.903062 25391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:08.894112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51709 (local address 127.0.0.1:37641)
0808 05:59:08.894595 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:08.894615 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:08.894660 (+ 45us) server_negotiation.cc:407] Connection header received
0808 05:59:08.895556 (+ 896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:08.895581 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:08.896028 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:08.896412 (+ 384us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:08.896872 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:08.898346 (+ 1474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:08.899311 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:08.900007 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:08.900176 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:08.901101 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:08.901108 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:08.901125 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:08.901683 (+ 558us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:08.901756 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:08.901791 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:08.901905 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:08.902055 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 05:59:08.902276 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":111,"threads_started":1}
I20260808 05:59:08.903684 25388 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e: No bootstrap required, opened a new log
I20260808 05:59:08.906056 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:08.908031 25388 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a3f15d6e384a0888634eab90ce028e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } }
I20260808 05:59:08.908318 25388 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:08.908387 25388 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6a3f15d6e384a0888634eab90ce028e, State: Initialized, Role: FOLLOWER
I20260808 05:59:08.908981 25388 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a3f15d6e384a0888634eab90ce028e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } }
I20260808 05:59:08.909185 25388 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:08.909271 25388 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:08.909389 25388 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:08.910633 25388 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a3f15d6e384a0888634eab90ce028e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } }
I20260808 05:59:08.910988 25388 leader_election.cc:302] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6a3f15d6e384a0888634eab90ce028e; no voters:
I20260808 05:59:08.911315 25388 leader_election.cc:288] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:08.911507 25398 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:08.911823 25398 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [term 1 LEADER]: Becoming Leader. State: Replica: e6a3f15d6e384a0888634eab90ce028e, State: Running, Role: LEADER
I20260808 05:59:08.912174 25398 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a3f15d6e384a0888634eab90ce028e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } }
I20260808 05:59:08.912834 25388 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:08.913584 25391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:08.908533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46639 (local address 127.0.0.1:37641)
0808 05:59:08.908664 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:08.908669 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:08.908983 (+ 314us) server_negotiation.cc:407] Connection header received
0808 05:59:08.909140 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:08.909144 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:08.909192 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:08.909306 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:08.909640 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:08.910399 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:08.911501 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:08.911856 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:08.912345 (+ 489us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:08.912901 (+ 556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:08.912906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:08.912909 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:08.912923 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:08.912953 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:08.912966 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:08.913339 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:08.913376 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 05:59:08.913432 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":46}
I20260808 05:59:08.913628 25398 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6a3f15d6e384a0888634eab90ce028e. Latest consensus state: current_term: 1 leader_uuid: "e6a3f15d6e384a0888634eab90ce028e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a3f15d6e384a0888634eab90ce028e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } } }
I20260808 05:59:08.913897 25398 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:08.914188 25399 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6a3f15d6e384a0888634eab90ce028e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6a3f15d6e384a0888634eab90ce028e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37641 } } }
I20260808 05:59:08.914319 25399 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e [sys.catalog]: This master's current role is: LEADER
W20260808 05:59:08.917917 25414 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:08.918006 25414 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:08.918123 25408 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:08.919166 25408 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:08.925160 25408 catalog_manager.cc:1347] Generated new cluster ID: 050ba6cf9a104b19b74f8f12b0e799d3
I20260808 05:59:08.925236 25408 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:08.949586 25408 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:08.950616 25408 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:08.955335 25408 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6a3f15d6e384a0888634eab90ce028e: Generated new TSK 0
I20260808 05:59:08.956164 25408 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:08.971244 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 25319
2026-08-08T05:59:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1553 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:09 dist-test-slave-qg60 krb5kdc[25420](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:09 dist-test-slave-qg60 krb5kdc[25420](info): set up 2 sockets
Aug 08 05:59:09 dist-test-slave-qg60 krb5kdc[25420](info): commencing operation
krb5kdc: starting...
W20260808 05:59:10.075235 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:10 dist-test-slave-qg60 krb5kdc[25420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:10.216221 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39085
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:10.333464 25434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:10.333788 25434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:10.333870 25434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:10.338029 25434 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:10.338126 25434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:10.338164 25434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:10.338227 25434 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:10.338264 25434 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:10.343708 25434 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:10.344877 25434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:10.345932 25434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:10.355047 25443 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:10.355068 25439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:10.355168 25441 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:10.355273 25434 server_base.cc:1034] running on GCE node
I20260808 05:59:10.355825 25434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:10.357062 25434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:10.358242 25434 hybrid_clock.cc:648] HybridClock initialized: now 1786168750358211 us; error 42 us; skew 500 ppm
Aug 08 05:59:10 dist-test-slave-qg60 krb5kdc[25420](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168750, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:10.361055 25434 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:10.361901 25434 webserver.cc:460] Webserver started at http://127.0.0.1:39981/ using document root <none> and password file <none>
I20260808 05:59:10.362463 25434 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:10.362526 25434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:10.362697 25434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:10.364825 25434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "c0e4c4e1df1e47db8350e971dad34468"
format_stamp: "Formatted at 2026-08-08 05:59:10 on dist-test-slave-qg60"
server_key: "f8b2176e188da4e8dfe7f23f0386a6c1"
server_key_iv: "74649d026cb5427ec6e0bf2a654d0911"
server_key_version: "encryptionkey@0"
I20260808 05:59:10.365379 25434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "c0e4c4e1df1e47db8350e971dad34468"
format_stamp: "Formatted at 2026-08-08 05:59:10 on dist-test-slave-qg60"
server_key: "f8b2176e188da4e8dfe7f23f0386a6c1"
server_key_iv: "74649d026cb5427ec6e0bf2a654d0911"
server_key_version: "encryptionkey@0"
I20260808 05:59:10.369345 25434 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20260808 05:59:10.371841 25450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:10.373124 25434 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:59:10.373288 25434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "c0e4c4e1df1e47db8350e971dad34468"
format_stamp: "Formatted at 2026-08-08 05:59:10 on dist-test-slave-qg60"
server_key: "f8b2176e188da4e8dfe7f23f0386a6c1"
server_key_iv: "74649d026cb5427ec6e0bf2a654d0911"
server_key_version: "encryptionkey@0"
I20260808 05:59:10.373405 25434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:10.378166 25434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:10.381484 25434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:10.381699 25434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:10.388978 25434 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39085
I20260808 05:59:10.389024 25504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39085 every 8 connection(s)
I20260808 05:59:10.389974 25434 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:10.392822 25505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:10.393733 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 25434
I20260808 05:59:10.393880 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:10.394234 2813 external_mini_cluster.cc:1428] Setting key d2983d4432a78ec2f5cdd81529ac8ceb
I20260808 05:59:10.399459 25505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468: Bootstrap starting.
I20260808 05:59:10.399653 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:10.395672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58899 (local address 127.0.0.1:39085)
0808 05:59:10.396172 (+ 500us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:10.396186 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:10.396222 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:59:10.396967 (+ 745us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:10.396987 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:10.397267 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:10.397615 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:10.398404 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:10.398408 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:10.398420 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:10.398430 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:10.398489 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:10.398508 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:10.398662 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:10.398733 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 05:59:10.398891 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":141,"threads_started":1}
I20260808 05:59:10.402172 25505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:10.402622 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:10.403021 25505 log.cc:824] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:10.405205 25505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468: No bootstrap required, opened a new log
I20260808 05:59:10.406673 25508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:10.404874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35163 (local address 127.0.0.1:39085)
0808 05:59:10.405016 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:10.405020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:10.405310 (+ 290us) server_negotiation.cc:407] Connection header received
0808 05:59:10.405387 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:10.405390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:10.405429 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:10.405504 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:10.406236 (+ 732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:10.406239 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:10.406241 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:10.406251 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:10.406274 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:10.406284 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:10.406363 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:10.406473 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 05:59:10.406515 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:59:10.409492 25505 raft_consensus.cc:348] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0e4c4e1df1e47db8350e971dad34468" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39085 } }
I20260808 05:59:10.409729 25505 raft_consensus.cc:374] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:10.409767 25505 raft_consensus.cc:729] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0e4c4e1df1e47db8350e971dad34468, State: Initialized, Role: FOLLOWER
I20260808 05:59:10.410233 25505 consensus_queue.cc:260] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0e4c4e1df1e47db8350e971dad34468" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39085 } }
I20260808 05:59:10.410357 25505 raft_consensus.cc:388] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:10.410446 25505 raft_consensus.cc:482] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:10.410596 25505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:10.411576 25505 raft_consensus.cc:504] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0e4c4e1df1e47db8350e971dad34468" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39085 } }
I20260808 05:59:10.411950 25505 leader_election.cc:302] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0e4c4e1df1e47db8350e971dad34468; no voters:
I20260808 05:59:10.412281 25505 leader_election.cc:288] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:10.412452 25516 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:10.412834 25516 raft_consensus.cc:686] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [term 1 LEADER]: Becoming Leader. State: Replica: c0e4c4e1df1e47db8350e971dad34468, State: Running, Role: LEADER
I20260808 05:59:10.413221 25516 consensus_queue.cc:237] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0e4c4e1df1e47db8350e971dad34468" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39085 } }
I20260808 05:59:10.413666 25505 sys_catalog.cc:564] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:10.415220 25518 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0e4c4e1df1e47db8350e971dad34468. Latest consensus state: current_term: 1 leader_uuid: "c0e4c4e1df1e47db8350e971dad34468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0e4c4e1df1e47db8350e971dad34468" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39085 } } }
I20260808 05:59:10.415258 25517 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0e4c4e1df1e47db8350e971dad34468" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0e4c4e1df1e47db8350e971dad34468" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39085 } } }
I20260808 05:59:10.415351 25518 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:10.415380 25517 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:10.415805 25528 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:10.419076 25528 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:10.424652 25528 catalog_manager.cc:1347] Generated new cluster ID: 26bb233652844fd0a06bdaf73f898ad6
I20260808 05:59:10.424757 25528 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:10.444813 25528 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:10.445210 25528 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:10.462513 25528 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c0e4c4e1df1e47db8350e971dad34468: Generated new TSK 0
I20260808 05:59:10.463567 25528 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:10.478992 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 25434
2026-08-08T05:59:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1507 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:10 dist-test-slave-qg60 krb5kdc[25537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:10 dist-test-slave-qg60 krb5kdc[25537](info): set up 2 sockets
Aug 08 05:59:10 dist-test-slave-qg60 krb5kdc[25537](info): commencing operation
krb5kdc: starting...
W20260808 05:59:11.638039 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.008s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:11 dist-test-slave-qg60 krb5kdc[25537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:11.776412 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40993
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37659
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40993
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:11.890421 25551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:11.890702 25551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:11.890748 25551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:11.894870 25551 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:11.894942 25551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:11.894963 25551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:11.894979 25551 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:11.894994 25551 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:11.900573 25551 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37659
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40993
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40993
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25551
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:11.901895 25551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:11.902957 25551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:11.911955 25559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:11.912045 25551 server_base.cc:1034] running on GCE node
W20260808 05:59:11.911996 25556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:11.911996 25557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:11.913049 25551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:11.914336 25551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:11.915581 25551 hybrid_clock.cc:648] HybridClock initialized: now 1786168751915558 us; error 33 us; skew 500 ppm
Aug 08 05:59:11 dist-test-slave-qg60 krb5kdc[25537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168751, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:11.918929 25551 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:11.919968 25551 webserver.cc:460] Webserver started at http://127.0.0.1:35497/ using document root <none> and password file <none>
I20260808 05:59:11.920583 25551 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:11.920682 25551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:11.920943 25551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:11.923072 25551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "99b8fa23a7da4972a079d8004178a583"
format_stamp: "Formatted at 2026-08-08 05:59:11 on dist-test-slave-qg60"
server_key: "553c45caf3da472b9d903e70f26c6cec"
server_key_iv: "ad707dd6589354bd277b90bef90c6c72"
server_key_version: "encryptionkey@0"
I20260808 05:59:11.923718 25551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "99b8fa23a7da4972a079d8004178a583"
format_stamp: "Formatted at 2026-08-08 05:59:11 on dist-test-slave-qg60"
server_key: "553c45caf3da472b9d903e70f26c6cec"
server_key_iv: "ad707dd6589354bd277b90bef90c6c72"
server_key_version: "encryptionkey@0"
I20260808 05:59:11.927698 25551 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20260808 05:59:11.930420 25567 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:11.931748 25551 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:59:11.931910 25551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "99b8fa23a7da4972a079d8004178a583"
format_stamp: "Formatted at 2026-08-08 05:59:11 on dist-test-slave-qg60"
server_key: "553c45caf3da472b9d903e70f26c6cec"
server_key_iv: "ad707dd6589354bd277b90bef90c6c72"
server_key_version: "encryptionkey@0"
I20260808 05:59:11.932049 25551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:11.943073 25551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:11.946762 25551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:11.946990 25551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:11.954610 25551 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40993
I20260808 05:59:11.954639 25621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40993 every 8 connection(s)
I20260808 05:59:11.955626 25551 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:11.958504 25622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:11.963958 25622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583: Bootstrap starting.
I20260808 05:59:11.964031 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 25551
I20260808 05:59:11.964198 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:11.964479 2813 external_mini_cluster.cc:1428] Setting key 7f166fe0d9f06d01b7ba145ad84646c6
I20260808 05:59:11.966743 25622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:11.967620 25622 log.cc:824] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:11.969954 25622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583: No bootstrap required, opened a new log
I20260808 05:59:11.974202 25622 raft_consensus.cc:348] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99b8fa23a7da4972a079d8004178a583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40993 } }
I20260808 05:59:11.974504 25622 raft_consensus.cc:374] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:11.974567 25622 raft_consensus.cc:729] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 99b8fa23a7da4972a079d8004178a583, State: Initialized, Role: FOLLOWER
Aug 08 05:59:11 dist-test-slave-qg60 krb5kdc[25537](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:59:11.975085 25622 consensus_queue.cc:260] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99b8fa23a7da4972a079d8004178a583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40993 } }
I20260808 05:59:11.975270 25622 raft_consensus.cc:388] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:11.975343 25622 raft_consensus.cc:482] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:11.975457 25622 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:11.976799 25622 raft_consensus.cc:504] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99b8fa23a7da4972a079d8004178a583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40993 } }
I20260808 05:59:11.977197 25622 leader_election.cc:302] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 99b8fa23a7da4972a079d8004178a583; no voters:
I20260808 05:59:11.977557 25622 leader_election.cc:288] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:11.977669 25627 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:11.977913 25627 raft_consensus.cc:686] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [term 1 LEADER]: Becoming Leader. State: Replica: 99b8fa23a7da4972a079d8004178a583, State: Running, Role: LEADER
I20260808 05:59:11.978328 25627 consensus_queue.cc:237] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99b8fa23a7da4972a079d8004178a583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40993 } }
I20260808 05:59:11.978981 25622 sys_catalog.cc:564] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:11.980086 25629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 99b8fa23a7da4972a079d8004178a583. Latest consensus state: current_term: 1 leader_uuid: "99b8fa23a7da4972a079d8004178a583" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99b8fa23a7da4972a079d8004178a583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40993 } } }
I20260808 05:59:11.980219 25629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:11.980542 25628 sys_catalog.cc:455] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "99b8fa23a7da4972a079d8004178a583" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "99b8fa23a7da4972a079d8004178a583" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40993 } } }
I20260808 05:59:11.980631 25628 sys_catalog.cc:458] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:11.982003 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:11.965987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:50095 (local address 127.0.0.1:40993)
0808 05:59:11.966404 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:11.966423 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:11.966465 (+ 42us) server_negotiation.cc:407] Connection header received
0808 05:59:11.967332 (+ 867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:11.967355 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:11.967802 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:11.968152 (+ 350us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:11.969018 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:11.970449 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:11.971324 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:11.972040 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:11.972214 (+ 174us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:11.975507 (+ 3293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:11.975516 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:11.975535 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:11.975573 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:11.977720 (+ 2147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:11.978375 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:11.978381 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:11.978387 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:11.978527 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:11.978951 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:11.978955 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:11.978956 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:11.979473 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:11.980495 (+ 1022us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:11.980698 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 05:59:11.980986 (+ 288us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":274,"thread_start_us":107,"threads_started":1}
W20260808 05:59:11.984386 25642 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:11.984472 25642 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:11.984552 25636 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:11.984958 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:11.985483 25636 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:11.992303 25636 catalog_manager.cc:1347] Generated new cluster ID: 82e7c82d0bd040dca603b29693c18ed9
I20260808 05:59:11.992384 25636 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:11.996713 25625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:11.987048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:55423 (local address 127.0.0.1:40993)
0808 05:59:11.987295 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:11.987301 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:11.987353 (+ 52us) server_negotiation.cc:407] Connection header received
0808 05:59:11.987526 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:11.987529 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:11.987591 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:11.987685 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:11.988517 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:11.989757 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:11.990768 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:11.991026 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:11.991143 (+ 117us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:11.992859 (+ 1716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:11.992864 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:11.992866 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:11.992895 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:11.994685 (+ 1790us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:11.995278 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:11.995282 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:11.995284 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:11.995382 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:11.995723 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:11.995727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:11.995729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:11.995962 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:11.996138 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:11.996408 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 05:59:11.996515 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172}
I20260808 05:59:12.012841 25636 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:12.013912 25636 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:12.022492 25636 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 99b8fa23a7da4972a079d8004178a583: Generated new TSK 0
I20260808 05:59:12.023262 25636 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:12.027979 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 25551
W20260808 05:59:12.035647 25535 connection.cc:535] client connection to 127.0.0.1:40993 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40993): Connection reset by peer (error 104)
2026-08-08T05:59:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1549 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:12 dist-test-slave-qg60 krb5kdc[25653](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:12 dist-test-slave-qg60 krb5kdc[25653](info): set up 2 sockets
Aug 08 05:59:12 dist-test-slave-qg60 krb5kdc[25653](info): commencing operation
krb5kdc: starting...
W20260808 05:59:13.134400 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.084s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:13 dist-test-slave-qg60 krb5kdc[25653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168753, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:13.276381 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36483
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36483
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:13.391363 25666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:13.391680 25666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:13.391757 25666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:13.395901 25666 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:13.396142 25666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:13.396200 25666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:13.396258 25666 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:13.396299 25666 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:13.402194 25666 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36483
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36483
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:13.403342 25666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:13.404435 25666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:13.413427 25672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:13.413409 25674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:13.413405 25671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:13.413451 25666 server_base.cc:1034] running on GCE node
I20260808 05:59:13.414278 25666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:13.415380 25666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:13.416610 25666 hybrid_clock.cc:648] HybridClock initialized: now 1786168753416582 us; error 48 us; skew 500 ppm
Aug 08 05:59:13 dist-test-slave-qg60 krb5kdc[25653](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168753, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:13.419787 25666 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:13.420902 25666 webserver.cc:460] Webserver started at http://127.0.0.1:34499/ using document root <none> and password file <none>
I20260808 05:59:13.421514 25666 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:13.421610 25666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:13.421851 25666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:13.424067 25666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "294fa12b27c043e5a07b4e184006f873"
format_stamp: "Formatted at 2026-08-08 05:59:13 on dist-test-slave-qg60"
server_key: "c8f5bb3101c524a251c8463b2a1f61e2"
server_key_iv: "a666b7bacb716996c0c46cf32e657d44"
server_key_version: "encryptionkey@0"
I20260808 05:59:13.424659 25666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "294fa12b27c043e5a07b4e184006f873"
format_stamp: "Formatted at 2026-08-08 05:59:13 on dist-test-slave-qg60"
server_key: "c8f5bb3101c524a251c8463b2a1f61e2"
server_key_iv: "a666b7bacb716996c0c46cf32e657d44"
server_key_version: "encryptionkey@0"
I20260808 05:59:13.428578 25666 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s
I20260808 05:59:13.431227 25681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:13.432675 25666 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:59:13.432871 25666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "294fa12b27c043e5a07b4e184006f873"
format_stamp: "Formatted at 2026-08-08 05:59:13 on dist-test-slave-qg60"
server_key: "c8f5bb3101c524a251c8463b2a1f61e2"
server_key_iv: "a666b7bacb716996c0c46cf32e657d44"
server_key_version: "encryptionkey@0"
I20260808 05:59:13.433023 25666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:13.446300 25666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:13.449682 25666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:13.449925 25666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:13.457720 25666 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36483
I20260808 05:59:13.457809 25737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36483 every 8 connection(s)
I20260808 05:59:13.458794 25666 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:13.461784 25738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:13.463728 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 25666
I20260808 05:59:13.463891 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:13.464184 2813 external_mini_cluster.cc:1428] Setting key e2df911b2bef0e887be26c1100354bc8
I20260808 05:59:13.468971 25738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873: Bootstrap starting.
I20260808 05:59:13.471597 25738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:13.472548 25738 log.cc:824] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:13.474627 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:13.465719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:57583 (local address 127.0.0.1:36483)
0808 05:59:13.466161 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:13.466182 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:13.466226 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:59:13.467005 (+ 779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:13.467031 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:13.467484 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:13.467852 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:13.468284 (+ 432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:13.469721 (+ 1437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:13.470662 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:13.471316 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:13.471489 (+ 173us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:13.472422 (+ 933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:13.472430 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:13.472445 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:13.472985 (+ 540us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:13.473058 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:13.473082 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:13.473202 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:13.473446 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 05:59:13.473586 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":284,"thread_start_us":114,"threads_started":1}
I20260808 05:59:13.474901 25738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873: No bootstrap required, opened a new log
I20260808 05:59:13.477818 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:13.479133 25738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294fa12b27c043e5a07b4e184006f873" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } }
I20260808 05:59:13.479386 25738 raft_consensus.cc:374] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:13.479471 25738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 294fa12b27c043e5a07b4e184006f873, State: Initialized, Role: FOLLOWER
I20260808 05:59:13.480033 25738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294fa12b27c043e5a07b4e184006f873" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } }
I20260808 05:59:13.480201 25738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:13.480285 25738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:13.480394 25738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:13.481475 25738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294fa12b27c043e5a07b4e184006f873" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } }
I20260808 05:59:13.481842 25738 leader_election.cc:302] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 294fa12b27c043e5a07b4e184006f873; no voters:
I20260808 05:59:13.482174 25738 leader_election.cc:288] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:13.482295 25748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:13.482604 25748 raft_consensus.cc:686] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [term 1 LEADER]: Becoming Leader. State: Replica: 294fa12b27c043e5a07b4e184006f873, State: Running, Role: LEADER
I20260808 05:59:13.482981 25748 consensus_queue.cc:237] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294fa12b27c043e5a07b4e184006f873" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } }
I20260808 05:59:13.483558 25738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:13.484287 25748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 294fa12b27c043e5a07b4e184006f873. Latest consensus state: current_term: 1 leader_uuid: "294fa12b27c043e5a07b4e184006f873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294fa12b27c043e5a07b4e184006f873" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } } }
I20260808 05:59:13.484797 25741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:13.479928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:49031 (local address 127.0.0.1:36483)
0808 05:59:13.480061 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:13.480065 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:13.480264 (+ 199us) server_negotiation.cc:407] Connection header received
0808 05:59:13.480416 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:13.480425 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:13.480468 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:13.480555 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:13.480871 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:13.481388 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:13.482482 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:13.482837 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:13.482945 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:13.483883 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:13.483886 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:13.483889 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:13.483903 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:13.483931 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:13.483943 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:13.484055 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:13.484548 (+ 493us) server_negotiation.cc:299] Negotiation successful
0808 05:59:13.484600 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:59:13.484969 25750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "294fa12b27c043e5a07b4e184006f873" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294fa12b27c043e5a07b4e184006f873" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36483 } } }
I20260808 05:59:13.485339 25750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:13.485093 25748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873 [sys.catalog]: This master's current role is: LEADER
W20260808 05:59:13.488451 25762 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:13.488523 25762 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:13.488616 25763 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:13.489378 25763 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:13.495411 25763 catalog_manager.cc:1347] Generated new cluster ID: ad3d720109654cf2954e8d16d3468103
I20260808 05:59:13.495484 25763 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:13.505620 25763 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:13.506942 25763 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:13.518288 25763 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 294fa12b27c043e5a07b4e184006f873: Generated new TSK 0
I20260808 05:59:13.519164 25763 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:13.530758 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 25666
W20260808 05:59:13.538179 25651 connection.cc:535] client connection to 127.0.0.1:36483 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36483): Connection reset by peer (error 104)
2026-08-08T05:59:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1502 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:13 dist-test-slave-qg60 krb5kdc[25769](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:13 dist-test-slave-qg60 krb5kdc[25769](info): set up 2 sockets
Aug 08 05:59:13 dist-test-slave-qg60 krb5kdc[25769](info): commencing operation
krb5kdc: starting...
W20260808 05:59:14.626088 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:14 dist-test-slave-qg60 krb5kdc[25769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:14.768901 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45623
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45623
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:14.885310 25782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:14.885684 25782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:14.885735 25782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:14.889804 25782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:14.889875 25782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:14.889895 25782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:14.889912 25782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:14.889927 25782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:14.895321 25782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45623
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45623
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25782
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:14.896481 25782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:14.897521 25782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:14.906718 25787 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:14.906816 25782 server_base.cc:1034] running on GCE node
W20260808 05:59:14.906742 25791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:14.906718 25789 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:14.907670 25782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:14.908941 25782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:14.910178 25782 hybrid_clock.cc:648] HybridClock initialized: now 1786168754910139 us; error 56 us; skew 500 ppm
Aug 08 05:59:14 dist-test-slave-qg60 krb5kdc[25769](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168754, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:14.918309 25782 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:14.919368 25782 webserver.cc:460] Webserver started at http://127.0.0.1:38093/ using document root <none> and password file <none>
I20260808 05:59:14.919960 25782 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:14.920053 25782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:14.920293 25782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:14.922564 25782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "d31494d36299451db0a69e5180ef4c82"
format_stamp: "Formatted at 2026-08-08 05:59:14 on dist-test-slave-qg60"
server_key: "5292b8050638ed4fcedd3a42a77a3095"
server_key_iv: "3c718c25733fd2a629c104733b77a8e4"
server_key_version: "encryptionkey@0"
I20260808 05:59:14.923147 25782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "d31494d36299451db0a69e5180ef4c82"
format_stamp: "Formatted at 2026-08-08 05:59:14 on dist-test-slave-qg60"
server_key: "5292b8050638ed4fcedd3a42a77a3095"
server_key_iv: "3c718c25733fd2a629c104733b77a8e4"
server_key_version: "encryptionkey@0"
I20260808 05:59:14.927140 25782 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s
I20260808 05:59:14.929911 25798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:14.931269 25782 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:14.931416 25782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "d31494d36299451db0a69e5180ef4c82"
format_stamp: "Formatted at 2026-08-08 05:59:14 on dist-test-slave-qg60"
server_key: "5292b8050638ed4fcedd3a42a77a3095"
server_key_iv: "3c718c25733fd2a629c104733b77a8e4"
server_key_version: "encryptionkey@0"
I20260808 05:59:14.931541 25782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:14.936328 25782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:14.939502 25782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:14.939721 25782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:14.947345 25782 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45623
I20260808 05:59:14.947373 25852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45623 every 8 connection(s)
I20260808 05:59:14.948410 25782 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:14.951555 25853 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:14.957077 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 25782
I20260808 05:59:14.957252 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:14.957573 2813 external_mini_cluster.cc:1428] Setting key 78b8922f2c12c765e4f710688d501abf
I20260808 05:59:14.958069 25853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82: Bootstrap starting.
I20260808 05:59:14.960873 25853 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:14.961843 25853 log.cc:824] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:14.963487 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:14.959114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:49261 (local address 127.0.0.1:45623)
0808 05:59:14.959610 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:14.959625 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:14.959670 (+ 45us) server_negotiation.cc:407] Connection header received
0808 05:59:14.960311 (+ 641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:14.960327 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:14.960606 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:14.960996 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:14.961840 (+ 844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:14.961845 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:14.961857 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:14.961867 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:14.961921 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:14.961940 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:14.962057 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:14.962299 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 05:59:14.962492 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":168,"threads_started":1}
I20260808 05:59:14.964234 25853 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82: No bootstrap required, opened a new log
I20260808 05:59:14.966495 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:14.968947 25853 raft_consensus.cc:348] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d31494d36299451db0a69e5180ef4c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } }
I20260808 05:59:14.969197 25853 raft_consensus.cc:374] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:14.969311 25853 raft_consensus.cc:729] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31494d36299451db0a69e5180ef4c82, State: Initialized, Role: FOLLOWER
I20260808 05:59:14.969894 25853 consensus_queue.cc:260] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d31494d36299451db0a69e5180ef4c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } }
I20260808 05:59:14.970082 25853 raft_consensus.cc:388] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:14.970172 25853 raft_consensus.cc:482] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:14.970292 25853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:14.970432 25856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:14.968612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:45043 (local address 127.0.0.1:45623)
0808 05:59:14.968751 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:14.968755 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:14.968959 (+ 204us) server_negotiation.cc:407] Connection header received
0808 05:59:14.969113 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:14.969117 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:14.969168 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:14.969270 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:14.970037 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:14.970040 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:14.970042 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:14.970054 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:14.970083 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:14.970094 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:14.970191 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:14.970263 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 05:59:14.970306 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:59:14.971486 25853 raft_consensus.cc:504] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d31494d36299451db0a69e5180ef4c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } }
I20260808 05:59:14.971894 25853 leader_election.cc:302] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d31494d36299451db0a69e5180ef4c82; no voters:
I20260808 05:59:14.972244 25853 leader_election.cc:288] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:14.972450 25863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:14.972704 25863 raft_consensus.cc:686] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [term 1 LEADER]: Becoming Leader. State: Replica: d31494d36299451db0a69e5180ef4c82, State: Running, Role: LEADER
I20260808 05:59:14.973073 25863 consensus_queue.cc:237] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d31494d36299451db0a69e5180ef4c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } }
I20260808 05:59:14.973726 25853 sys_catalog.cc:564] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:14.974967 25865 sys_catalog.cc:455] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d31494d36299451db0a69e5180ef4c82. Latest consensus state: current_term: 1 leader_uuid: "d31494d36299451db0a69e5180ef4c82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d31494d36299451db0a69e5180ef4c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } } }
I20260808 05:59:14.975108 25865 sys_catalog.cc:458] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:14.975425 25864 sys_catalog.cc:455] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d31494d36299451db0a69e5180ef4c82" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d31494d36299451db0a69e5180ef4c82" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45623 } } }
I20260808 05:59:14.975590 25864 sys_catalog.cc:458] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:14.975590 25872 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:14.978938 25872 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:14.985847 25872 catalog_manager.cc:1347] Generated new cluster ID: 1ff9747a7a7049c4b83b5869680a870b
I20260808 05:59:14.985936 25872 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:15.007228 25872 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:15.007648 25872 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:15.017802 25872 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d31494d36299451db0a69e5180ef4c82: Generated new TSK 0
I20260808 05:59:15.018822 25872 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:15.024906 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 25782
2026-08-08T05:59:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1494 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:15 dist-test-slave-qg60 krb5kdc[25885](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:15 dist-test-slave-qg60 krb5kdc[25885](info): set up 2 sockets
Aug 08 05:59:15 dist-test-slave-qg60 krb5kdc[25885](info): commencing operation
krb5kdc: starting...
W20260808 05:59:16.130630 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:16 dist-test-slave-qg60 krb5kdc[25885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:16.267916 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39109
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:16.384286 25899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:16.384606 25899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:16.384697 25899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:16.388819 25899 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:16.388944 25899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:16.388990 25899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:16.389029 25899 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:16.389060 25899 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:16.394675 25899 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39109
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:16.395869 25899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:16.396996 25899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:16.405936 25908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:16.405982 25906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:16.405982 25905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:16.406261 25899 server_base.cc:1034] running on GCE node
I20260808 05:59:16.406822 25899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:16.407934 25899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:16.409126 25899 hybrid_clock.cc:648] HybridClock initialized: now 1786168756409092 us; error 48 us; skew 500 ppm
Aug 08 05:59:16 dist-test-slave-qg60 krb5kdc[25885](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168756, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:16.412212 25899 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:16.413218 25899 webserver.cc:460] Webserver started at http://127.0.0.1:36091/ using document root <none> and password file <none>
I20260808 05:59:16.413800 25899 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:16.413897 25899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:16.414149 25899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:16.416283 25899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "2c0572d0e1b8499a85a6475c1a6094ae"
format_stamp: "Formatted at 2026-08-08 05:59:16 on dist-test-slave-qg60"
server_key: "2e0c3fc1b43c4c57e1445a703047a05f"
server_key_iv: "73dbab7e4147d958e6ae05a043000465"
server_key_version: "encryptionkey@0"
I20260808 05:59:16.416926 25899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "2c0572d0e1b8499a85a6475c1a6094ae"
format_stamp: "Formatted at 2026-08-08 05:59:16 on dist-test-slave-qg60"
server_key: "2e0c3fc1b43c4c57e1445a703047a05f"
server_key_iv: "73dbab7e4147d958e6ae05a043000465"
server_key_version: "encryptionkey@0"
I20260808 05:59:16.420647 25899 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:16.423430 25916 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:16.424845 25899 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:16.424993 25899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "2c0572d0e1b8499a85a6475c1a6094ae"
format_stamp: "Formatted at 2026-08-08 05:59:16 on dist-test-slave-qg60"
server_key: "2e0c3fc1b43c4c57e1445a703047a05f"
server_key_iv: "73dbab7e4147d958e6ae05a043000465"
server_key_version: "encryptionkey@0"
I20260808 05:59:16.425117 25899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:16.437947 25899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:16.441545 25899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:16.441772 25899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:16.449316 25899 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39109
I20260808 05:59:16.449384 25970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39109 every 8 connection(s)
I20260808 05:59:16.450341 25899 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:16.453238 25971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:16.455384 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 25899
I20260808 05:59:16.455538 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:16.455832 2813 external_mini_cluster.cc:1428] Setting key 042615eb9e16667dcb6e705a1a6d8a75
I20260808 05:59:16.460529 25971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae: Bootstrap starting.
I20260808 05:59:16.463255 25971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:16.464048 25971 log.cc:824] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae: Log is configured to *not* fsync() on all Append() calls
Aug 08 05:59:16 dist-test-slave-qg60 krb5kdc[25885](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168756, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:59:16.466277 25971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae: No bootstrap required, opened a new log
I20260808 05:59:16.471352 25971 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0572d0e1b8499a85a6475c1a6094ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39109 } }
I20260808 05:59:16.471652 25971 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:16.471704 25971 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0572d0e1b8499a85a6475c1a6094ae, State: Initialized, Role: FOLLOWER
I20260808 05:59:16.471814 25974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:16.457259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:38001 (local address 127.0.0.1:39109)
0808 05:59:16.457676 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:16.457697 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:16.457740 (+ 43us) server_negotiation.cc:407] Connection header received
0808 05:59:16.458566 (+ 826us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:16.458591 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:16.459080 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:16.459450 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:16.460160 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:16.461613 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:16.462443 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:16.463133 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:16.463318 (+ 185us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:16.466127 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:16.466134 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:16.466151 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:16.466180 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:16.468302 (+ 2122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:16.468954 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:16.468964 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:16.468973 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:16.469118 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:16.469453 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:16.469456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:16.469458 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:16.470000 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:16.470235 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:16.470492 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 05:59:16.470737 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":104,"threads_started":1}
I20260808 05:59:16.472215 25971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0572d0e1b8499a85a6475c1a6094ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39109 } }
I20260808 05:59:16.472409 25971 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:16.472517 25971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:16.472622 25971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:16.473903 25971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0572d0e1b8499a85a6475c1a6094ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39109 } }
I20260808 05:59:16.474304 25971 leader_election.cc:302] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2c0572d0e1b8499a85a6475c1a6094ae; no voters:
I20260808 05:59:16.474696 25971 leader_election.cc:288] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:16.474812 25976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:16.475028 25976 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [term 1 LEADER]: Becoming Leader. State: Replica: 2c0572d0e1b8499a85a6475c1a6094ae, State: Running, Role: LEADER
I20260808 05:59:16.475392 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:16.475409 25976 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0572d0e1b8499a85a6475c1a6094ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39109 } }
I20260808 05:59:16.475952 25971 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:16.477178 25977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2c0572d0e1b8499a85a6475c1a6094ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0572d0e1b8499a85a6475c1a6094ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39109 } } }
I20260808 05:59:16.477310 25977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:16.477687 25978 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2c0572d0e1b8499a85a6475c1a6094ae. Latest consensus state: current_term: 1 leader_uuid: "2c0572d0e1b8499a85a6475c1a6094ae" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2c0572d0e1b8499a85a6475c1a6094ae" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39109 } } }
I20260808 05:59:16.477851 25978 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:16.477938 25989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:16.481372 25989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:16.487744 25989 catalog_manager.cc:1347] Generated new cluster ID: a59be3df8ad54b16ae681add9aa4f509
I20260808 05:59:16.487807 25989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:16.489048 25974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:16.479122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:58477 (local address 127.0.0.1:39109)
0808 05:59:16.479263 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:16.479270 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:16.479446 (+ 176us) server_negotiation.cc:407] Connection header received
0808 05:59:16.479654 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:16.479657 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:16.479709 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:16.479797 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:16.480633 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:16.481414 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:16.482653 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:16.482983 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:16.483098 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:16.485024 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:16.485027 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:16.485030 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:16.485055 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:16.486893 (+ 1838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:16.487530 (+ 637us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:16.487533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:16.487535 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:16.487622 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:16.488036 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:16.488039 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:16.488041 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:16.488256 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:16.488410 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:16.488756 (+ 346us) server_negotiation.cc:299] Negotiation successful
0808 05:59:16.488864 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:59:16.507642 25989 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:16.509048 25989 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:16.513676 25989 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2c0572d0e1b8499a85a6475c1a6094ae: Generated new TSK 0
I20260808 05:59:16.514480 25989 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:16.519407 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 25899
W20260808 05:59:16.527570 25883 connection.cc:535] client connection to 127.0.0.1:39109 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39109): Connection reset by peer (error 104)
2026-08-08T05:59:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1494 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:16 dist-test-slave-qg60 krb5kdc[26003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:16 dist-test-slave-qg60 krb5kdc[26003](info): set up 2 sockets
Aug 08 05:59:16 dist-test-slave-qg60 krb5kdc[26003](info): commencing operation
krb5kdc: starting...
W20260808 05:59:17.653678 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.111s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:17 dist-test-slave-qg60 krb5kdc[26003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168757, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:17.789450 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33511
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39517
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33511
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:17.905108 26018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:17.905462 26018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:17.905547 26018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:17.909852 26018 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:17.909955 26018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:17.909993 26018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:17.910033 26018 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:17.910066 26018 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:17.915638 26018 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39517
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33511
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33511
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:17.916863 26018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:17.917929 26018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:17.926983 26027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:17.927109 26025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:17.926983 26024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:17.927218 26018 server_base.cc:1034] running on GCE node
I20260808 05:59:17.927985 26018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:17.929378 26018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:17.930583 26018 hybrid_clock.cc:648] HybridClock initialized: now 1786168757930555 us; error 42 us; skew 500 ppm
Aug 08 05:59:17 dist-test-slave-qg60 krb5kdc[26003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168757, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:17.933676 26018 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:17.934717 26018 webserver.cc:460] Webserver started at http://127.0.0.1:35639/ using document root <none> and password file <none>
I20260808 05:59:17.935326 26018 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:17.935425 26018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:17.935686 26018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:17.938032 26018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "ac462c082ae84e888fae70d3b44e313d"
format_stamp: "Formatted at 2026-08-08 05:59:17 on dist-test-slave-qg60"
server_key: "ee271d0f645c39f3a30a589c2e8e0190"
server_key_iv: "34ac1fbd52d15f09c5f687b16eae8970"
server_key_version: "encryptionkey@0"
I20260808 05:59:17.938642 26018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "ac462c082ae84e888fae70d3b44e313d"
format_stamp: "Formatted at 2026-08-08 05:59:17 on dist-test-slave-qg60"
server_key: "ee271d0f645c39f3a30a589c2e8e0190"
server_key_iv: "34ac1fbd52d15f09c5f687b16eae8970"
server_key_version: "encryptionkey@0"
I20260808 05:59:17.942886 26018 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:17.945777 26034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:17.947185 26018 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:17.947350 26018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "ac462c082ae84e888fae70d3b44e313d"
format_stamp: "Formatted at 2026-08-08 05:59:17 on dist-test-slave-qg60"
server_key: "ee271d0f645c39f3a30a589c2e8e0190"
server_key_iv: "34ac1fbd52d15f09c5f687b16eae8970"
server_key_version: "encryptionkey@0"
I20260808 05:59:17.947477 26018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:17.968202 26018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:17.971669 26018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:17.971891 26018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:17.979493 26018 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33511
I20260808 05:59:17.979583 26088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33511 every 8 connection(s)
I20260808 05:59:17.980530 26018 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:17.983532 26089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:17.987222 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26018
I20260808 05:59:17.987428 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:17.987747 2813 external_mini_cluster.cc:1428] Setting key c40d37254e7613d9892072b604a42bba
I20260808 05:59:17.990168 26089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d: Bootstrap starting.
I20260808 05:59:17.993144 26089 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:17.994064 26089 log.cc:824] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:17.996434 26089 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d: No bootstrap required, opened a new log
I20260808 05:59:17.998958 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:17.989363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:59297 (local address 127.0.0.1:33511)
0808 05:59:17.989839 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:17.989865 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:17.989909 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:59:17.990775 (+ 866us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:17.990802 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:17.991274 (+ 472us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:17.991677 (+ 403us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:17.992131 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:17.993656 (+ 1525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:17.994711 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:17.995359 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:17.995522 (+ 163us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:17.996444 (+ 922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:17.996453 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:17.996475 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:17.997035 (+ 560us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:17.997121 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:17.997154 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:17.997299 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:17.997522 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 05:59:17.997678 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":318,"thread_start_us":136,"threads_started":1}
I20260808 05:59:18.000542 26089 raft_consensus.cc:348] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac462c082ae84e888fae70d3b44e313d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260808 05:59:18.000861 26089 raft_consensus.cc:374] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:18.000919 26089 raft_consensus.cc:729] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac462c082ae84e888fae70d3b44e313d, State: Initialized, Role: FOLLOWER
I20260808 05:59:18.001428 26089 consensus_queue.cc:260] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac462c082ae84e888fae70d3b44e313d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260808 05:59:18.001616 26089 raft_consensus.cc:388] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:18.001756 26089 raft_consensus.cc:482] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:18.001897 26089 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:18.002557 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:18.003075 26089 raft_consensus.cc:504] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac462c082ae84e888fae70d3b44e313d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260808 05:59:18.003477 26089 leader_election.cc:302] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ac462c082ae84e888fae70d3b44e313d; no voters:
I20260808 05:59:18.003865 26089 leader_election.cc:288] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:18.004055 26094 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:18.004374 26094 raft_consensus.cc:686] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [term 1 LEADER]: Becoming Leader. State: Replica: ac462c082ae84e888fae70d3b44e313d, State: Running, Role: LEADER
I20260808 05:59:18.004869 26094 consensus_queue.cc:237] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac462c082ae84e888fae70d3b44e313d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } }
I20260808 05:59:18.005455 26089 sys_catalog.cc:564] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:18.006553 26100 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [sys.catalog]: SysCatalogTable state changed. Reason: New leader ac462c082ae84e888fae70d3b44e313d. Latest consensus state: current_term: 1 leader_uuid: "ac462c082ae84e888fae70d3b44e313d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac462c082ae84e888fae70d3b44e313d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } } }
I20260808 05:59:18.006721 26100 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:18.006978 26102 sys_catalog.cc:455] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ac462c082ae84e888fae70d3b44e313d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ac462c082ae84e888fae70d3b44e313d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33511 } } }
I20260808 05:59:18.007100 26102 sys_catalog.cc:458] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:18.007552 26110 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:18.011016 26110 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:18.011773 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:18.005262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:53147 (local address 127.0.0.1:33511)
0808 05:59:18.005404 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:18.005409 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:18.006699 (+ 1290us) server_negotiation.cc:407] Connection header received
0808 05:59:18.006979 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:18.006984 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:18.007048 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:18.007112 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:18.007667 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:18.008579 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:18.009772 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:18.010028 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:18.010174 (+ 146us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:18.011244 (+ 1070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:18.011247 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:18.011249 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:18.011262 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:18.011289 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:18.011300 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:18.011430 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:18.011569 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 05:59:18.011608 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:59:18.017381 26110 catalog_manager.cc:1347] Generated new cluster ID: 3c75a26bbd0a4829be470d1faf67d0f4
I20260808 05:59:18.017472 26110 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:18.027009 26110 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:18.028064 26110 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:18.036975 26110 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ac462c082ae84e888fae70d3b44e313d: Generated new TSK 0
I20260808 05:59:18.037786 26110 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:18.045830 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26018
W20260808 05:59:18.053862 26001 connection.cc:535] client connection to 127.0.0.1:33511 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33511): Connection reset by peer (error 104)
2026-08-08T05:59:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1526 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:18 dist-test-slave-qg60 krb5kdc[26122](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:18 dist-test-slave-qg60 krb5kdc[26122](info): set up 2 sockets
Aug 08 05:59:18 dist-test-slave-qg60 krb5kdc[26122](info): commencing operation
krb5kdc: starting...
W20260808 05:59:19.137012 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:19 dist-test-slave-qg60 krb5kdc[26122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168759, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:59:19.284273 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45297
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37685
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45297
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:19.401127 26135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:19.401485 26135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:19.401576 26135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:19.405771 26135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:19.405880 26135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:19.405921 26135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:19.405983 26135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:19.406024 26135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:19.411566 26135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37685
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45297
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:19.412788 26135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:19.413964 26135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:19.423048 26140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:19.423041 26144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:19.423089 26142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:19.423311 26135 server_base.cc:1034] running on GCE node
I20260808 05:59:19.423971 26135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:19.425194 26135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:19.426386 26135 hybrid_clock.cc:648] HybridClock initialized: now 1786168759426367 us; error 31 us; skew 500 ppm
Aug 08 05:59:19 dist-test-slave-qg60 krb5kdc[26122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168759, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:19.429747 26135 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:59:19.430706 26135 webserver.cc:460] Webserver started at http://127.0.0.1:37697/ using document root <none> and password file <none>
I20260808 05:59:19.431325 26135 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:19.431421 26135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:19.431676 26135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:19.433876 26135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "b81bfcf6e2f143ca8291f9285eee75b9"
format_stamp: "Formatted at 2026-08-08 05:59:19 on dist-test-slave-qg60"
server_key: "b5bb2bfc1db69ef5b7288d7f8f208ca3"
server_key_iv: "8f9d9aa4e8c25e2b2fa3850c944df4cd"
server_key_version: "encryptionkey@0"
I20260808 05:59:19.434456 26135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "b81bfcf6e2f143ca8291f9285eee75b9"
format_stamp: "Formatted at 2026-08-08 05:59:19 on dist-test-slave-qg60"
server_key: "b5bb2bfc1db69ef5b7288d7f8f208ca3"
server_key_iv: "8f9d9aa4e8c25e2b2fa3850c944df4cd"
server_key_version: "encryptionkey@0"
I20260808 05:59:19.438374 26135 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:19.440977 26151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:19.442205 26135 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:59:19.442358 26135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "b81bfcf6e2f143ca8291f9285eee75b9"
format_stamp: "Formatted at 2026-08-08 05:59:19 on dist-test-slave-qg60"
server_key: "b5bb2bfc1db69ef5b7288d7f8f208ca3"
server_key_iv: "8f9d9aa4e8c25e2b2fa3850c944df4cd"
server_key_version: "encryptionkey@0"
I20260808 05:59:19.442477 26135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:19.447252 26135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:19.450696 26135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:19.450908 26135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:19.458586 26135 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45297
I20260808 05:59:19.458627 26205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45297 every 8 connection(s)
I20260808 05:59:19.459604 26135 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:19.462278 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26135
I20260808 05:59:19.462445 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:19.462808 2813 external_mini_cluster.cc:1428] Setting key 9f9101d6379cb4df9d02a755a50aa689
I20260808 05:59:19.463246 26206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:19.468370 26209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:19.464324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:52961 (local address 127.0.0.1:45297)
0808 05:59:19.464808 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:19.464825 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:19.464863 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:59:19.465541 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:19.465559 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:19.465858 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:19.466151 (+ 293us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:19.467075 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:19.467080 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:19.467091 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:19.467101 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:19.467160 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:19.467180 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:19.467293 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:19.467430 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:59:19.467607 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":160,"threads_started":1}
I20260808 05:59:19.471089 26206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9: Bootstrap starting.
I20260808 05:59:19.471432 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:19.474196 26206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:19.475111 26206 log.cc:824] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:19.475752 26209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:19.474003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.24:34969 (local address 127.0.0.1:45297)
0808 05:59:19.474165 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:19.474170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:19.474283 (+ 113us) server_negotiation.cc:407] Connection header received
0808 05:59:19.474421 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:19.474426 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:19.474471 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:19.474576 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:19.475329 (+ 753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:19.475333 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:19.475335 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:19.475346 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:19.475380 (+ 34us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:19.475390 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:19.475481 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:19.475564 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 05:59:19.475603 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 05:59:19.477356 26206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9: No bootstrap required, opened a new log
I20260808 05:59:19.481411 26206 raft_consensus.cc:348] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81bfcf6e2f143ca8291f9285eee75b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45297 } }
I20260808 05:59:19.481648 26206 raft_consensus.cc:374] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:19.481719 26206 raft_consensus.cc:729] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b81bfcf6e2f143ca8291f9285eee75b9, State: Initialized, Role: FOLLOWER
I20260808 05:59:19.482159 26206 consensus_queue.cc:260] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81bfcf6e2f143ca8291f9285eee75b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45297 } }
I20260808 05:59:19.482308 26206 raft_consensus.cc:388] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:19.482376 26206 raft_consensus.cc:482] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:19.482506 26206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:19.483497 26206 raft_consensus.cc:504] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81bfcf6e2f143ca8291f9285eee75b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45297 } }
I20260808 05:59:19.483843 26206 leader_election.cc:302] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b81bfcf6e2f143ca8291f9285eee75b9; no voters:
I20260808 05:59:19.484159 26206 leader_election.cc:288] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:19.484321 26216 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:19.484588 26216 raft_consensus.cc:686] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [term 1 LEADER]: Becoming Leader. State: Replica: b81bfcf6e2f143ca8291f9285eee75b9, State: Running, Role: LEADER
I20260808 05:59:19.484977 26216 consensus_queue.cc:237] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81bfcf6e2f143ca8291f9285eee75b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45297 } }
I20260808 05:59:19.485536 26206 sys_catalog.cc:564] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:19.486864 26217 sys_catalog.cc:455] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b81bfcf6e2f143ca8291f9285eee75b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81bfcf6e2f143ca8291f9285eee75b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45297 } } }
I20260808 05:59:19.487015 26217 sys_catalog.cc:458] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:19.487406 26218 sys_catalog.cc:455] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b81bfcf6e2f143ca8291f9285eee75b9. Latest consensus state: current_term: 1 leader_uuid: "b81bfcf6e2f143ca8291f9285eee75b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b81bfcf6e2f143ca8291f9285eee75b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45297 } } }
I20260808 05:59:19.487524 26218 sys_catalog.cc:458] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:19.487474 26225 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:19.491261 26225 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:19.497437 26225 catalog_manager.cc:1347] Generated new cluster ID: d2b5376bec1d4003b66f8f9405b21a1e
I20260808 05:59:19.497526 26225 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:19.518162 26225 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:19.518541 26225 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:19.526752 26225 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b81bfcf6e2f143ca8291f9285eee75b9: Generated new TSK 0
I20260808 05:59:19.527635 26225 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:19.539739 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26135
2026-08-08T05:59:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1494 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:19 dist-test-slave-qg60 krb5kdc[26238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:19 dist-test-slave-qg60 krb5kdc[26238](info): set up 2 sockets
Aug 08 05:59:19 dist-test-slave-qg60 krb5kdc[26238](info): commencing operation
krb5kdc: starting...
W20260808 05:59:20.687114 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.124s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:20 dist-test-slave-qg60 krb5kdc[26238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:59:20.832021 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:36779
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44195
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:36779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:20.954206 26251 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:20.954537 26251 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:20.954627 26251 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:20.958900 26251 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:20.959012 26251 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:20.959051 26251 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:20.959089 26251 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:20.959125 26251 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:20.964684 26251 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44195
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:36779
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:36779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26251
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:20.965898 26251 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:20.967021 26251 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:20.976018 26259 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:20.976182 26251 server_base.cc:1034] running on GCE node
W20260808 05:59:20.976161 26257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:20.976401 26256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:20.977048 26251 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:20.978256 26251 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:20.979425 26251 hybrid_clock.cc:648] HybridClock initialized: now 1786168760979405 us; error 31 us; skew 500 ppm
Aug 08 05:59:20 dist-test-slave-qg60 krb5kdc[26238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168760, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:20.987687 26251 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:59:20.988709 26251 webserver.cc:460] Webserver started at http://127.2.191.126:41535/ using document root <none> and password file <none>
I20260808 05:59:20.989372 26251 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:20.989475 26251 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:20.989725 26251 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:20.991907 26251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "6e5473ec53374de1ba00aa5257baa47e"
format_stamp: "Formatted at 2026-08-08 05:59:20 on dist-test-slave-qg60"
server_key: "d97f11d68cf51d7ecd940e3dba79ff95"
server_key_iv: "6724bf0ce7cd675f2b4c0f3fbee456cc"
server_key_version: "encryptionkey@0"
I20260808 05:59:20.992542 26251 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "6e5473ec53374de1ba00aa5257baa47e"
format_stamp: "Formatted at 2026-08-08 05:59:20 on dist-test-slave-qg60"
server_key: "d97f11d68cf51d7ecd940e3dba79ff95"
server_key_iv: "6724bf0ce7cd675f2b4c0f3fbee456cc"
server_key_version: "encryptionkey@0"
I20260808 05:59:20.996822 26251 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 05:59:20.999667 26266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:21.001178 26251 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:21.001344 26251 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "6e5473ec53374de1ba00aa5257baa47e"
format_stamp: "Formatted at 2026-08-08 05:59:20 on dist-test-slave-qg60"
server_key: "d97f11d68cf51d7ecd940e3dba79ff95"
server_key_iv: "6724bf0ce7cd675f2b4c0f3fbee456cc"
server_key_version: "encryptionkey@0"
I20260808 05:59:21.001483 26251 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:21.012384 26251 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:21.015579 26251 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:21.015828 26251 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:21.023888 26251 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:36779
I20260808 05:59:21.023916 26319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:36779 every 8 connection(s)
I20260808 05:59:21.025094 26251 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:21.028013 26320 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:21.030285 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26251
I20260808 05:59:21.030452 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:21.030754 2813 external_mini_cluster.cc:1428] Setting key f3553bfca6df3754e7be24179053d5bf
I20260808 05:59:21.035326 26320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e: Bootstrap starting.
I20260808 05:59:21.037735 26320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:21.038579 26320 log.cc:824] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e: Log is configured to *not* fsync() on all Append() calls
Aug 08 05:59:21 dist-test-slave-qg60 krb5kdc[26238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168760, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:59:21.040904 26320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e: No bootstrap required, opened a new log
I20260808 05:59:21.045261 26320 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5473ec53374de1ba00aa5257baa47e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36779 } }
I20260808 05:59:21.045488 26320 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:21.045549 26320 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e5473ec53374de1ba00aa5257baa47e, State: Initialized, Role: FOLLOWER
I20260808 05:59:21.045965 26323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:21.032348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48475 (local address 127.2.191.126:36779)
0808 05:59:21.032928 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:21.032945 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:21.032985 (+ 40us) server_negotiation.cc:407] Connection header received
0808 05:59:21.033670 (+ 685us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:21.033690 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:21.034049 (+ 359us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:21.034416 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:21.035275 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:21.036343 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:21.037326 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:21.037858 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:21.038042 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:21.041015 (+ 2973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:21.041022 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:21.041044 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:21.041072 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:21.042761 (+ 1689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:21.043387 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:21.043392 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:21.043397 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:21.043508 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:21.043850 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:21.043852 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:21.043853 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:21.044233 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:21.044410 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:21.044797 (+ 387us) server_negotiation.cc:299] Negotiation successful
0808 05:59:21.045056 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":414,"thread_start_us":162,"threads_started":1}
I20260808 05:59:21.046025 26320 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5473ec53374de1ba00aa5257baa47e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36779 } }
I20260808 05:59:21.046200 26320 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:21.046280 26320 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:21.046352 26320 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:21.047334 26320 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5473ec53374de1ba00aa5257baa47e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36779 } }
I20260808 05:59:21.047693 26320 leader_election.cc:302] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e5473ec53374de1ba00aa5257baa47e; no voters:
I20260808 05:59:21.048079 26320 leader_election.cc:288] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:21.048156 26325 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:21.048429 26325 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [term 1 LEADER]: Becoming Leader. State: Replica: 6e5473ec53374de1ba00aa5257baa47e, State: Running, Role: LEADER
I20260808 05:59:21.048755 26325 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5473ec53374de1ba00aa5257baa47e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36779 } }
I20260808 05:59:21.049299 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:21.049502 26320 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:21.050657 26326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e5473ec53374de1ba00aa5257baa47e. Latest consensus state: current_term: 1 leader_uuid: "6e5473ec53374de1ba00aa5257baa47e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5473ec53374de1ba00aa5257baa47e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36779 } } }
I20260808 05:59:21.050833 26326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:21.050655 26327 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e5473ec53374de1ba00aa5257baa47e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e5473ec53374de1ba00aa5257baa47e" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 36779 } } }
I20260808 05:59:21.051158 26327 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:21.051366 26338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:21.054842 26338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:21.061830 26323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:21.052190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42157 (local address 127.2.191.126:36779)
0808 05:59:21.052289 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:21.052293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:21.052621 (+ 328us) server_negotiation.cc:407] Connection header received
0808 05:59:21.052804 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:21.052808 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:21.052854 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:21.052905 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:21.053807 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:21.054625 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:21.055789 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:21.056037 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:21.056152 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:21.057939 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:21.057942 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:21.057945 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:21.057973 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:21.059713 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:21.060272 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:21.060276 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:21.060277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:21.060372 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:21.060805 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:21.060811 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:21.060816 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:21.061057 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:21.061237 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:21.061530 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 05:59:21.061657 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:59:21.062870 26338 catalog_manager.cc:1347] Generated new cluster ID: e876989f3bac45658d552c280f93c7fc
I20260808 05:59:21.062942 26338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:21.091161 26338 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:21.092221 26338 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:21.098234 26338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e5473ec53374de1ba00aa5257baa47e: Generated new TSK 0
I20260808 05:59:21.099023 26338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:21.109258 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26251
W20260808 05:59:21.116951 26236 connection.cc:535] client connection to 127.2.191.126:36779 recv error: Network error: failed to read from TLS socket (remote: 127.2.191.126:36779): Connection reset by peer (error 104)
2026-08-08T05:59:21Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1568 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:21 dist-test-slave-qg60 krb5kdc[26353](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:21 dist-test-slave-qg60 krb5kdc[26353](info): set up 2 sockets
Aug 08 05:59:21 dist-test-slave-qg60 krb5kdc[26353](info): commencing operation
krb5kdc: starting...
W20260808 05:59:22.197062 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:22 dist-test-slave-qg60 krb5kdc[26353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168762, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:59:22.336413 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44147
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40153
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:44147
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:22.455507 26366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:22.455807 26366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:22.455856 26366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:22.460637 26366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:22.460712 26366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:22.460799 26366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:22.460821 26366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:22.460837 26366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:22.467276 26366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40153
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:44147
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:22.468500 26366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:22.469655 26366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:22.479146 26372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:22.479331 26366 server_base.cc:1034] running on GCE node
W20260808 05:59:22.479192 26371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:22.479146 26374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:22.480130 26366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:22.481539 26366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:22.482748 26366 hybrid_clock.cc:648] HybridClock initialized: now 1786168762482734 us; error 29 us; skew 500 ppm
Aug 08 05:59:22 dist-test-slave-qg60 krb5kdc[26353](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168762, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:22.486059 26366 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:59:22.487108 26366 webserver.cc:460] Webserver started at http://127.2.191.126:46781/ using document root <none> and password file <none>
I20260808 05:59:22.487716 26366 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:22.487815 26366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:22.488071 26366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:22.490324 26366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "d94262ec1553498294cb29051f975c26"
format_stamp: "Formatted at 2026-08-08 05:59:22 on dist-test-slave-qg60"
server_key: "d0d549a90a17732d5ff926c4fd364f28"
server_key_iv: "a66377b70f70443e66c5be24d9d70447"
server_key_version: "encryptionkey@0"
I20260808 05:59:22.490909 26366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "d94262ec1553498294cb29051f975c26"
format_stamp: "Formatted at 2026-08-08 05:59:22 on dist-test-slave-qg60"
server_key: "d0d549a90a17732d5ff926c4fd364f28"
server_key_iv: "a66377b70f70443e66c5be24d9d70447"
server_key_version: "encryptionkey@0"
I20260808 05:59:22.495210 26366 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:22.498262 26382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:22.499586 26366 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:59:22.499747 26366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "d94262ec1553498294cb29051f975c26"
format_stamp: "Formatted at 2026-08-08 05:59:22 on dist-test-slave-qg60"
server_key: "d0d549a90a17732d5ff926c4fd364f28"
server_key_iv: "a66377b70f70443e66c5be24d9d70447"
server_key_version: "encryptionkey@0"
I20260808 05:59:22.499881 26366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:22.519304 26366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:22.522931 26366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:22.523242 26366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:22.531975 26366 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:44147
I20260808 05:59:22.532001 26436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:44147 every 8 connection(s)
I20260808 05:59:22.533202 26366 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:22.534426 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26366
I20260808 05:59:22.534548 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:22.534926 2813 external_mini_cluster.cc:1428] Setting key faff6383203d590775d30ceed71c6502
I20260808 05:59:22.536580 26437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:22.544777 26437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26: Bootstrap starting.
I20260808 05:59:22.546622 26440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:22.536436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41365 (local address 127.2.191.126:44147)
0808 05:59:22.536973 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:22.536993 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:22.537040 (+ 47us) server_negotiation.cc:407] Connection header received
0808 05:59:22.537904 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:22.537927 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:22.538371 (+ 444us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:22.538888 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:22.539324 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:22.540922 (+ 1598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:22.541975 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:22.542705 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:22.542876 (+ 171us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:22.544129 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:22.544136 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:22.544154 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:22.544801 (+ 647us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:22.544889 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:22.544926 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:22.545098 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:22.545372 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 05:59:22.545540 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":182,"threads_started":1}
I20260808 05:59:22.548105 26437 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:22.549157 26437 log.cc:824] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:22.550295 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:22.551530 26437 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26: No bootstrap required, opened a new log
I20260808 05:59:22.556738 26437 raft_consensus.cc:348] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94262ec1553498294cb29051f975c26" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44147 } }
I20260808 05:59:22.557149 26437 raft_consensus.cc:374] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:22.557250 26437 raft_consensus.cc:729] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d94262ec1553498294cb29051f975c26, State: Initialized, Role: FOLLOWER
I20260808 05:59:22.557694 26440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:22.552894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46823 (local address 127.2.191.126:44147)
0808 05:59:22.553036 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:22.553040 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:22.553256 (+ 216us) server_negotiation.cc:407] Connection header received
0808 05:59:22.553342 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:22.553345 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:22.553385 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:22.553460 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:22.553858 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:22.554451 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:22.555730 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:22.555940 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:22.556028 (+ 88us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:22.557110 (+ 1082us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:22.557113 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:22.557116 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:22.557127 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:22.557206 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:22.557221 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:22.557344 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:22.557481 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:59:22.557538 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 05:59:22.557842 26437 consensus_queue.cc:260] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94262ec1553498294cb29051f975c26" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44147 } }
I20260808 05:59:22.558032 26437 raft_consensus.cc:388] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:22.558116 26437 raft_consensus.cc:482] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:22.558230 26437 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:22.559321 26437 raft_consensus.cc:504] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94262ec1553498294cb29051f975c26" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44147 } }
I20260808 05:59:22.559716 26437 leader_election.cc:302] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d94262ec1553498294cb29051f975c26; no voters:
I20260808 05:59:22.560141 26437 leader_election.cc:288] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:22.560322 26447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:22.560580 26447 raft_consensus.cc:686] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [term 1 LEADER]: Becoming Leader. State: Replica: d94262ec1553498294cb29051f975c26, State: Running, Role: LEADER
I20260808 05:59:22.561002 26447 consensus_queue.cc:237] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94262ec1553498294cb29051f975c26" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44147 } }
I20260808 05:59:22.561652 26437 sys_catalog.cc:564] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:22.562778 26449 sys_catalog.cc:455] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d94262ec1553498294cb29051f975c26. Latest consensus state: current_term: 1 leader_uuid: "d94262ec1553498294cb29051f975c26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94262ec1553498294cb29051f975c26" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44147 } } }
I20260808 05:59:22.562947 26449 sys_catalog.cc:458] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:22.563406 26456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:22.563401 26448 sys_catalog.cc:455] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d94262ec1553498294cb29051f975c26" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d94262ec1553498294cb29051f975c26" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44147 } } }
I20260808 05:59:22.564088 26448 sys_catalog.cc:458] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:22.567185 26456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:22.572834 26456 catalog_manager.cc:1347] Generated new cluster ID: 260fa207a96c4fc4bcdee72062539e5b
I20260808 05:59:22.572991 26456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:22.599716 26456 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:22.601051 26456 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:22.613026 26456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d94262ec1553498294cb29051f975c26: Generated new TSK 0
I20260808 05:59:22.613914 26456 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:22.629755 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26366
W20260808 05:59:22.638798 26351 connection.cc:535] client connection to 127.2.191.126:44147 recv error: Network error: failed to read from TLS socket (remote: 127.2.191.126:44147): Connection reset by peer (error 104)
2026-08-08T05:59:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1522 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:22 dist-test-slave-qg60 krb5kdc[26468](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:22 dist-test-slave-qg60 krb5kdc[26468](info): set up 2 sockets
Aug 08 05:59:22 dist-test-slave-qg60 krb5kdc[26468](info): commencing operation
krb5kdc: starting...
W20260808 05:59:23.729543 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:23 dist-test-slave-qg60 krb5kdc[26468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168763, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:59:23.870117 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:41437
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:34121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:41437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:23.990907 26482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:23.991256 26482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:23.991356 26482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:23.995641 26482 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:23.995760 26482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:23.995801 26482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:23.995858 26482 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:23.995903 26482 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:24.001758 26482 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:34121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:41437
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:41437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26482
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:24.003031 26482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:24.004132 26482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:24.013088 26488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:24.013103 26490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:24.013124 26487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:24.013290 26482 server_base.cc:1034] running on GCE node
I20260808 05:59:24.014012 26482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:24.015272 26482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:24.016455 26482 hybrid_clock.cc:648] HybridClock initialized: now 1786168764016424 us; error 48 us; skew 500 ppm
Aug 08 05:59:24 dist-test-slave-qg60 krb5kdc[26468](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168764, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:24.019830 26482 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:59:24.020901 26482 webserver.cc:460] Webserver started at http://127.2.191.126:34773/ using document root <none> and password file <none>
I20260808 05:59:24.021513 26482 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:24.021620 26482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:24.021876 26482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:24.024075 26482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "299e3985a46540ad8b252a1d260f20bc"
format_stamp: "Formatted at 2026-08-08 05:59:24 on dist-test-slave-qg60"
server_key: "23e22ef3169d1cd41fcbcfec373a32bd"
server_key_iv: "ccec7b00438405c7167d06ed50c63f9f"
server_key_version: "encryptionkey@0"
I20260808 05:59:24.024674 26482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "299e3985a46540ad8b252a1d260f20bc"
format_stamp: "Formatted at 2026-08-08 05:59:24 on dist-test-slave-qg60"
server_key: "23e22ef3169d1cd41fcbcfec373a32bd"
server_key_iv: "ccec7b00438405c7167d06ed50c63f9f"
server_key_version: "encryptionkey@0"
I20260808 05:59:24.028714 26482 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20260808 05:59:24.031297 26499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:24.032644 26482 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:59:24.032811 26482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "299e3985a46540ad8b252a1d260f20bc"
format_stamp: "Formatted at 2026-08-08 05:59:24 on dist-test-slave-qg60"
server_key: "23e22ef3169d1cd41fcbcfec373a32bd"
server_key_iv: "ccec7b00438405c7167d06ed50c63f9f"
server_key_version: "encryptionkey@0"
I20260808 05:59:24.032933 26482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:24.037596 26482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:24.040860 26482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:24.041064 26482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:24.048664 26482 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:41437
I20260808 05:59:24.048784 26554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:41437 every 8 connection(s)
I20260808 05:59:24.049708 26482 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:24.052635 26555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:24.058030 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26482
I20260808 05:59:24.058202 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:24.058512 2813 external_mini_cluster.cc:1428] Setting key 09c804d93cb736fe35e1e5c61d101897
I20260808 05:59:24.059219 26555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc: Bootstrap starting.
I20260808 05:59:24.061867 26555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:24.062808 26555 log.cc:824] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:24.064181 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:24.059969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55141 (local address 127.2.191.126:41437)
0808 05:59:24.060484 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:24.060500 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:24.060539 (+ 39us) server_negotiation.cc:407] Connection header received
0808 05:59:24.061335 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:24.061355 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:24.061682 (+ 327us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:24.062052 (+ 370us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:24.062900 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:24.062905 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:24.062917 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:24.062928 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:24.063021 (+ 93us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:24.063044 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:24.063162 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:24.063270 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 05:59:24.063447 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":150,"threads_started":1}
I20260808 05:59:24.065073 26555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc: No bootstrap required, opened a new log
I20260808 05:59:24.067406 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:24.069473 26555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299e3985a46540ad8b252a1d260f20bc" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41437 } }
I20260808 05:59:24.069785 26555 raft_consensus.cc:374] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:24.069854 26555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 299e3985a46540ad8b252a1d260f20bc, State: Initialized, Role: FOLLOWER
I20260808 05:59:24.070300 26555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299e3985a46540ad8b252a1d260f20bc" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41437 } }
I20260808 05:59:24.070465 26555 raft_consensus.cc:388] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:24.070545 26555 raft_consensus.cc:482] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:24.070684 26555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:24.071715 26558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:24.069794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51591 (local address 127.2.191.126:41437)
0808 05:59:24.069916 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:24.069940 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:24.070184 (+ 244us) server_negotiation.cc:407] Connection header received
0808 05:59:24.070360 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:24.070363 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:24.070409 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:24.070502 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:24.071298 (+ 796us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:24.071302 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:24.071305 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:24.071317 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:24.071345 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:24.071365 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:24.071459 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:24.071536 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 05:59:24.071579 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:59:24.071691 26555 raft_consensus.cc:504] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299e3985a46540ad8b252a1d260f20bc" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41437 } }
I20260808 05:59:24.072141 26555 leader_election.cc:302] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 299e3985a46540ad8b252a1d260f20bc; no voters:
I20260808 05:59:24.072484 26555 leader_election.cc:288] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:24.072605 26567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:24.072881 26567 raft_consensus.cc:686] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [term 1 LEADER]: Becoming Leader. State: Replica: 299e3985a46540ad8b252a1d260f20bc, State: Running, Role: LEADER
I20260808 05:59:24.073288 26567 consensus_queue.cc:237] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299e3985a46540ad8b252a1d260f20bc" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41437 } }
I20260808 05:59:24.073801 26555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:24.075098 26568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 299e3985a46540ad8b252a1d260f20bc. Latest consensus state: current_term: 1 leader_uuid: "299e3985a46540ad8b252a1d260f20bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299e3985a46540ad8b252a1d260f20bc" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41437 } } }
I20260808 05:59:24.075232 26568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:24.075568 26569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "299e3985a46540ad8b252a1d260f20bc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "299e3985a46540ad8b252a1d260f20bc" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 41437 } } }
I20260808 05:59:24.075664 26569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:24.075780 26576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:24.079345 26576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:24.092823 26576 catalog_manager.cc:1347] Generated new cluster ID: a07ca5a5acd841198334abd87a4aa204
I20260808 05:59:24.092914 26576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:24.124290 26576 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:24.124631 26576 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:24.130816 26576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 299e3985a46540ad8b252a1d260f20bc: Generated new TSK 0
I20260808 05:59:24.131518 26576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:24.139981 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26482
2026-08-08T05:59:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1510 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:24 dist-test-slave-qg60 krb5kdc[26588](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:24 dist-test-slave-qg60 krb5kdc[26588](info): set up 2 sockets
Aug 08 05:59:24 dist-test-slave-qg60 krb5kdc[26588](info): commencing operation
krb5kdc: starting...
W20260808 05:59:25.242147 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:25 dist-test-slave-qg60 krb5kdc[26588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:59:25.378186 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:35857
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:44171
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:35857
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:25.518461 26602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:25.518814 26602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:25.518936 26602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:25.523573 26602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:25.523674 26602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:25.523718 26602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:25.523783 26602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:25.523826 26602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:25.529906 26602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:44171
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:35857
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:35857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:25.531092 26602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:25.532209 26602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:25.541029 26607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:25.541054 26608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:25.541342 26602 server_base.cc:1034] running on GCE node
W20260808 05:59:25.541342 26610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:25.541996 26602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:25.543094 26602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:25.544270 26602 hybrid_clock.cc:648] HybridClock initialized: now 1786168765544252 us; error 33 us; skew 500 ppm
Aug 08 05:59:25 dist-test-slave-qg60 krb5kdc[26588](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168765, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:25.547250 26602 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:59:25.548259 26602 webserver.cc:460] Webserver started at http://127.2.191.126:42329/ using document root <none> and password file <none>
I20260808 05:59:25.548931 26602 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:25.549031 26602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:25.549273 26602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:25.551369 26602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "eb8124fa6a014c79a9e71945fc1f60e6"
format_stamp: "Formatted at 2026-08-08 05:59:25 on dist-test-slave-qg60"
server_key: "9aa4f9e3beb088cf421e706a1aa4116e"
server_key_iv: "f04fac90a43e05d011a54003c3aa307e"
server_key_version: "encryptionkey@0"
I20260808 05:59:25.551947 26602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "eb8124fa6a014c79a9e71945fc1f60e6"
format_stamp: "Formatted at 2026-08-08 05:59:25 on dist-test-slave-qg60"
server_key: "9aa4f9e3beb088cf421e706a1aa4116e"
server_key_iv: "f04fac90a43e05d011a54003c3aa307e"
server_key_version: "encryptionkey@0"
I20260808 05:59:25.555873 26602 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20260808 05:59:25.558408 26617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:25.559790 26602 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:59:25.560024 26602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "eb8124fa6a014c79a9e71945fc1f60e6"
format_stamp: "Formatted at 2026-08-08 05:59:25 on dist-test-slave-qg60"
server_key: "9aa4f9e3beb088cf421e706a1aa4116e"
server_key_iv: "f04fac90a43e05d011a54003c3aa307e"
server_key_version: "encryptionkey@0"
I20260808 05:59:25.560166 26602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:25.586499 26602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:25.589999 26602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:25.590248 26602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:25.597995 26602 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:35857
I20260808 05:59:25.598061 26672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:35857 every 8 connection(s)
I20260808 05:59:25.599128 26602 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:25.602062 26673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:25.606215 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26602
I20260808 05:59:25.606369 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:25.606684 2813 external_mini_cluster.cc:1428] Setting key b08ed3c9949aa2e568345a40308e3b44
I20260808 05:59:25.608417 26673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6: Bootstrap starting.
I20260808 05:59:25.611047 26673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:25.611780 26673 log.cc:824] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:25.613929 26673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6: No bootstrap required, opened a new log
Aug 08 05:59:25 dist-test-slave-qg60 krb5kdc[26588](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168765, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:59:25.618909 26673 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8124fa6a014c79a9e71945fc1f60e6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35857 } }
I20260808 05:59:25.619225 26673 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:25.619290 26673 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8124fa6a014c79a9e71945fc1f60e6, State: Initialized, Role: FOLLOWER
I20260808 05:59:25.619812 26673 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8124fa6a014c79a9e71945fc1f60e6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35857 } }
I20260808 05:59:25.620029 26673 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:25.620108 26673 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:25.620213 26673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:25.621471 26673 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8124fa6a014c79a9e71945fc1f60e6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35857 } }
I20260808 05:59:25.621855 26673 leader_election.cc:302] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb8124fa6a014c79a9e71945fc1f60e6; no voters:
I20260808 05:59:25.622222 26673 leader_election.cc:288] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:25.622356 26678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:25.622381 26676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:25.608103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56717 (local address 127.2.191.126:35857)
0808 05:59:25.608579 (+ 476us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:25.608606 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:25.608644 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:59:25.609367 (+ 723us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:25.609383 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:25.609722 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:25.610002 (+ 280us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:25.610901 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:25.612023 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:25.613135 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:25.613619 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:25.613748 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:25.616793 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:25.616799 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:25.616816 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:25.616851 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:25.618937 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:25.619473 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:25.619479 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:25.619485 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:25.619625 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:25.619892 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:25.619895 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:25.619897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:25.620469 (+ 572us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:25.620685 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:25.620985 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 05:59:25.621329 (+ 344us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":160,"threads_started":1}
I20260808 05:59:25.622589 26678 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [term 1 LEADER]: Becoming Leader. State: Replica: eb8124fa6a014c79a9e71945fc1f60e6, State: Running, Role: LEADER
I20260808 05:59:25.622947 26678 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8124fa6a014c79a9e71945fc1f60e6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35857 } }
I20260808 05:59:25.623510 26673 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:25.624289 26680 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb8124fa6a014c79a9e71945fc1f60e6. Latest consensus state: current_term: 1 leader_uuid: "eb8124fa6a014c79a9e71945fc1f60e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8124fa6a014c79a9e71945fc1f60e6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35857 } } }
I20260808 05:59:25.624431 26680 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:25.624802 26679 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb8124fa6a014c79a9e71945fc1f60e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8124fa6a014c79a9e71945fc1f60e6" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 35857 } } }
I20260808 05:59:25.624892 26686 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:25.624899 26679 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:25.626503 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:25.628424 26686 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:25.638278 26676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:25.628966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39315 (local address 127.2.191.126:35857)
0808 05:59:25.629093 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:25.629098 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:25.629616 (+ 518us) server_negotiation.cc:407] Connection header received
0808 05:59:25.629780 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:25.629783 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:25.629840 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:25.629924 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:25.630606 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:25.631164 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:25.632022 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:25.632291 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:25.632402 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:25.634074 (+ 1672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:25.634079 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:25.634082 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:25.634109 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:25.636327 (+ 2218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:25.636872 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:25.636876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:25.636877 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:25.636969 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:25.637288 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:25.637292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:25.637294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:25.637526 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:25.637662 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:25.637964 (+ 302us) server_negotiation.cc:299] Negotiation successful
0808 05:59:25.638111 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:59:25.638491 26686 catalog_manager.cc:1347] Generated new cluster ID: 69b2ce65ba79456aafdb4694f3582c42
I20260808 05:59:25.638578 26686 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:25.660171 26686 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:25.661401 26686 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:25.670540 26686 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb8124fa6a014c79a9e71945fc1f60e6: Generated new TSK 0
I20260808 05:59:25.671289 26686 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:25.675387 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26602
2026-08-08T05:59:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1534 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:25 dist-test-slave-qg60 krb5kdc[26705](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:25 dist-test-slave-qg60 krb5kdc[26705](info): set up 2 sockets
Aug 08 05:59:25 dist-test-slave-qg60 krb5kdc[26705](info): commencing operation
krb5kdc: starting...
W20260808 05:59:26.777242 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:26 dist-test-slave-qg60 krb5kdc[26705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168766, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:59:26.911988 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44599
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:41223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:44599
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:27.028636 26719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:27.029009 26719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:27.029055 26719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:27.033116 26719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:27.033179 26719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:27.033198 26719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:27.033215 26719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:27.033259 26719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:27.038839 26719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:41223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:44599
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:44599
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26719
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:27.039986 26719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:27.041064 26719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:27.050402 26728 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:27.050495 26719 server_base.cc:1034] running on GCE node
W20260808 05:59:27.050402 26725 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:27.050700 26726 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:27.051357 26719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:27.052592 26719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:27.053822 26719 hybrid_clock.cc:648] HybridClock initialized: now 1786168767053801 us; error 35 us; skew 500 ppm
Aug 08 05:59:27 dist-test-slave-qg60 krb5kdc[26705](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168767, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:27.062256 26719 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:59:27.063273 26719 webserver.cc:460] Webserver started at http://127.2.191.126:39499/ using document root <none> and password file <none>
I20260808 05:59:27.063855 26719 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:27.063921 26719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:27.064141 26719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:27.066447 26719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "b3fa30f018ae463ab116e27fbe83f584"
format_stamp: "Formatted at 2026-08-08 05:59:27 on dist-test-slave-qg60"
server_key: "8e23305a6d46e2decea346e95d0664c2"
server_key_iv: "a92d58ab81585ed6495342f5ff2deb0a"
server_key_version: "encryptionkey@0"
I20260808 05:59:27.067020 26719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "b3fa30f018ae463ab116e27fbe83f584"
format_stamp: "Formatted at 2026-08-08 05:59:27 on dist-test-slave-qg60"
server_key: "8e23305a6d46e2decea346e95d0664c2"
server_key_iv: "a92d58ab81585ed6495342f5ff2deb0a"
server_key_version: "encryptionkey@0"
I20260808 05:59:27.070947 26719 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:27.073508 26736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:27.074781 26719 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:59:27.074923 26719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "b3fa30f018ae463ab116e27fbe83f584"
format_stamp: "Formatted at 2026-08-08 05:59:27 on dist-test-slave-qg60"
server_key: "8e23305a6d46e2decea346e95d0664c2"
server_key_iv: "a92d58ab81585ed6495342f5ff2deb0a"
server_key_version: "encryptionkey@0"
I20260808 05:59:27.075037 26719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:27.108186 26719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:27.112093 26719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:27.112324 26719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:27.119995 26719 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:44599
I20260808 05:59:27.120026 26792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:44599 every 8 connection(s)
I20260808 05:59:27.121013 26719 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:27.123812 26793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:27.129565 26793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584: Bootstrap starting.
I20260808 05:59:27.130323 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26719
I20260808 05:59:27.130465 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:27.130759 2813 external_mini_cluster.cc:1428] Setting key a4091a70476cc8f4e4896cc3772c4ee8
I20260808 05:59:27.132637 26793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:27.133438 26793 log.cc:824] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:27.135356 26793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584: No bootstrap required, opened a new log
I20260808 05:59:27.139185 26793 raft_consensus.cc:348] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3fa30f018ae463ab116e27fbe83f584" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44599 } }
I20260808 05:59:27.139443 26793 raft_consensus.cc:374] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:27.139542 26793 raft_consensus.cc:729] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b3fa30f018ae463ab116e27fbe83f584, State: Initialized, Role: FOLLOWER
I20260808 05:59:27.140051 26793 consensus_queue.cc:260] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3fa30f018ae463ab116e27fbe83f584" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44599 } }
I20260808 05:59:27.140282 26793 raft_consensus.cc:388] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:27.140373 26793 raft_consensus.cc:482] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:27.140479 26793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:27.140870 26796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:27.132112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38987 (local address 127.2.191.126:44599)
0808 05:59:27.132607 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:27.132624 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:27.132663 (+ 39us) server_negotiation.cc:407] Connection header received
0808 05:59:27.133476 (+ 813us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:27.133495 (+ 19us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:27.133932 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:27.134300 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:27.134752 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:27.135891 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:27.137046 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:27.137583 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:27.137790 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:27.138751 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:27.138757 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:27.138771 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:27.139190 (+ 419us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:27.139250 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:27.139274 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:27.139390 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:27.139625 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 05:59:27.139870 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":346,"thread_start_us":137,"threads_started":1}
I20260808 05:59:27.141749 26793 raft_consensus.cc:504] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3fa30f018ae463ab116e27fbe83f584" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44599 } }
I20260808 05:59:27.142100 26793 leader_election.cc:302] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b3fa30f018ae463ab116e27fbe83f584; no voters:
I20260808 05:59:27.142434 26793 leader_election.cc:288] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:27.142546 26798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:27.142791 26798 raft_consensus.cc:686] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [term 1 LEADER]: Becoming Leader. State: Replica: b3fa30f018ae463ab116e27fbe83f584, State: Running, Role: LEADER
I20260808 05:59:27.143177 26798 consensus_queue.cc:237] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3fa30f018ae463ab116e27fbe83f584" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44599 } }
I20260808 05:59:27.143792 26793 sys_catalog.cc:564] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:27.144071 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:27.144968 26799 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b3fa30f018ae463ab116e27fbe83f584" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3fa30f018ae463ab116e27fbe83f584" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44599 } } }
I20260808 05:59:27.145108 26799 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:27.145327 26800 sys_catalog.cc:455] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b3fa30f018ae463ab116e27fbe83f584. Latest consensus state: current_term: 1 leader_uuid: "b3fa30f018ae463ab116e27fbe83f584" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b3fa30f018ae463ab116e27fbe83f584" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 44599 } } }
I20260808 05:59:27.145408 26800 sys_catalog.cc:458] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:27.145680 26808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:27.149022 26808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:27.151643 26796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:27.146801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38081 (local address 127.2.191.126:44599)
0808 05:59:27.146898 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:27.146903 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:27.147115 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:59:27.147256 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:27.147259 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:27.147308 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:27.147391 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:27.147793 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:27.148548 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:27.149758 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:27.150102 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:27.150227 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:27.151138 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:27.151142 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:27.151145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:27.151158 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:27.151188 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:27.151201 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:27.151280 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:27.151438 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 05:59:27.151493 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:59:27.154919 26808 catalog_manager.cc:1347] Generated new cluster ID: 6aa6b05f41ec44bc8c8d49eda306ba01
I20260808 05:59:27.154985 26808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:27.168943 26808 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:27.169958 26808 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:27.177291 26808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b3fa30f018ae463ab116e27fbe83f584: Generated new TSK 0
I20260808 05:59:27.178081 26808 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:27.189638 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26719
2026-08-08T05:59:27Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1514 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:27 dist-test-slave-qg60 krb5kdc[26827](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:27 dist-test-slave-qg60 krb5kdc[26827](info): set up 2 sockets
Aug 08 05:59:27 dist-test-slave-qg60 krb5kdc[26827](info): commencing operation
krb5kdc: starting...
W20260808 05:59:28.286479 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:28 dist-test-slave-qg60 krb5kdc[26827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168768, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:59:28.424881 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:37363
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:33975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:37363
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:28.541822 26841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:28.542176 26841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:28.542269 26841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:28.546824 26841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:28.546927 26841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:28.546975 26841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:28.547044 26841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:28.547083 26841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:28.552512 26841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:33975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:37363
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:37363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:28.553696 26841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:28.554808 26841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:28.564085 26847 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:28.564296 26841 server_base.cc:1034] running on GCE node
W20260808 05:59:28.564085 26846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:28.564123 26849 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:28.565111 26841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:28.566274 26841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:28.567442 26841 hybrid_clock.cc:648] HybridClock initialized: now 1786168768567431 us; error 26 us; skew 500 ppm
Aug 08 05:59:28 dist-test-slave-qg60 krb5kdc[26827](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168768, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:28.570299 26841 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:59:28.571252 26841 webserver.cc:460] Webserver started at http://127.2.191.126:45205/ using document root <none> and password file <none>
I20260808 05:59:28.571826 26841 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:28.571888 26841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:28.572131 26841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:28.574267 26841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "94900488364f47218fbde59d0125f377"
format_stamp: "Formatted at 2026-08-08 05:59:28 on dist-test-slave-qg60"
server_key: "e429c640d6027e7d2e730a5700ab15ea"
server_key_iv: "64ff42a9632418163e9c55d902e01c1d"
server_key_version: "encryptionkey@0"
I20260808 05:59:28.574921 26841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "94900488364f47218fbde59d0125f377"
format_stamp: "Formatted at 2026-08-08 05:59:28 on dist-test-slave-qg60"
server_key: "e429c640d6027e7d2e730a5700ab15ea"
server_key_iv: "64ff42a9632418163e9c55d902e01c1d"
server_key_version: "encryptionkey@0"
I20260808 05:59:28.578764 26841 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:28.581238 26857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:28.582499 26841 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:59:28.582654 26841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "94900488364f47218fbde59d0125f377"
format_stamp: "Formatted at 2026-08-08 05:59:28 on dist-test-slave-qg60"
server_key: "e429c640d6027e7d2e730a5700ab15ea"
server_key_iv: "64ff42a9632418163e9c55d902e01c1d"
server_key_version: "encryptionkey@0"
I20260808 05:59:28.582777 26841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:28.587419 26841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:28.590890 26841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:28.591106 26841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:28.598932 26841 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:37363
I20260808 05:59:28.598954 26915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:37363 every 8 connection(s)
I20260808 05:59:28.599893 26841 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:28.602336 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26841
I20260808 05:59:28.602519 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:28.602833 2813 external_mini_cluster.cc:1428] Setting key ce03ec6afc2854570459207d2a813fc0
I20260808 05:59:28.603089 26916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:28.608659 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:28.604513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48061 (local address 127.2.191.126:37363)
0808 05:59:28.605161 (+ 648us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:28.605189 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:28.605227 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:59:28.605849 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:28.605865 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:28.606160 (+ 295us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:28.606470 (+ 310us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:28.607428 (+ 958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:28.607438 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:28.607450 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:28.607461 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:28.607517 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:28.607540 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:28.607656 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:28.607778 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 05:59:28.607903 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"spinlock_wait_cycles":56576,"thread_start_us":291,"threads_started":1}
I20260808 05:59:28.610350 26916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377: Bootstrap starting.
I20260808 05:59:28.611492 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:28.613044 26916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:28.613987 26916 log.cc:824] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:28.616323 26916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377: No bootstrap required, opened a new log
I20260808 05:59:28.616969 26920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:28.614030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56863 (local address 127.2.191.126:37363)
0808 05:59:28.614209 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:28.614214 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:28.614500 (+ 286us) server_negotiation.cc:407] Connection header received
0808 05:59:28.614664 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:28.614666 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:28.614705 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:28.614788 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:28.616536 (+ 1748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:28.616539 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:28.616542 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:59:28.616554 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:28.616580 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:59:28.616599 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:28.616694 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:28.616808 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 05:59:28.616849 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260808 05:59:28.620253 26916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94900488364f47218fbde59d0125f377" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37363 } }
I20260808 05:59:28.620471 26916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:59:28.620540 26916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94900488364f47218fbde59d0125f377, State: Initialized, Role: FOLLOWER
I20260808 05:59:28.621029 26916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94900488364f47218fbde59d0125f377" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37363 } }
I20260808 05:59:28.621162 26916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:59:28.621243 26916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:59:28.621340 26916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:28.622330 26916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94900488364f47218fbde59d0125f377" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37363 } }
I20260808 05:59:28.622670 26916 leader_election.cc:302] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 94900488364f47218fbde59d0125f377; no voters:
I20260808 05:59:28.623018 26916 leader_election.cc:288] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:59:28.623147 26927 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:28.623409 26927 raft_consensus.cc:686] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [term 1 LEADER]: Becoming Leader. State: Replica: 94900488364f47218fbde59d0125f377, State: Running, Role: LEADER
I20260808 05:59:28.623822 26927 consensus_queue.cc:237] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94900488364f47218fbde59d0125f377" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37363 } }
I20260808 05:59:28.624418 26916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:28.625777 26929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 94900488364f47218fbde59d0125f377. Latest consensus state: current_term: 1 leader_uuid: "94900488364f47218fbde59d0125f377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94900488364f47218fbde59d0125f377" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37363 } } }
I20260808 05:59:28.625833 26928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "94900488364f47218fbde59d0125f377" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "94900488364f47218fbde59d0125f377" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 37363 } } }
I20260808 05:59:28.625912 26929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:28.625942 26928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377 [sys.catalog]: This master's current role is: LEADER
W20260808 05:59:28.629447 26944 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:28.629570 26944 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:28.629654 26938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:28.630393 26938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:28.636494 26938 catalog_manager.cc:1347] Generated new cluster ID: 06bf85b7b0ba4c89896e65b72875e60e
I20260808 05:59:28.636574 26938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:28.654984 26938 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:28.655321 26938 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:28.662428 26938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 94900488364f47218fbde59d0125f377: Generated new TSK 0
I20260808 05:59:28.663157 26938 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:59:28.679466 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26841
2026-08-08T05:59:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1488 ms)
[----------] 18 tests from AuthTokenIssuingTest (27353 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:28 dist-test-slave-qg60 krb5kdc[26950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:28 dist-test-slave-qg60 krb5kdc[26950](info): set up 2 sockets
Aug 08 05:59:28 dist-test-slave-qg60 krb5kdc[26950](info): commencing operation
krb5kdc: starting...
W20260808 05:59:29.817951 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.116s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:29 dist-test-slave-qg60 krb5kdc[26950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:59:29.952117 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42271
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:42271,127.2.191.125:41739,127.2.191.124:42331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:30.070081 26964 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:59:30.070441 26964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:30.070469 26964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:30.070556 26964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:30.074896 26964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:30.074975 26964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:30.074996 26964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:30.075016 26964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:30.075054 26964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:30.081195 26964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:42271,127.2.191.125:41739,127.2.191.124:42331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:42271
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:30.082368 26964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:30.083442 26964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:30.092548 26972 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:30.092557 26969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:30.092604 26970 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:30.092713 26964 server_base.cc:1034] running on GCE node
I20260808 05:59:30.093503 26964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:30.094772 26964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:30.095981 26964 hybrid_clock.cc:648] HybridClock initialized: now 1786168770095967 us; error 29 us; skew 500 ppm
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:30.099222 26964 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:59:30.100145 26964 webserver.cc:460] Webserver started at http://127.2.191.126:45115/ using document root <none> and password file <none>
I20260808 05:59:30.100775 26964 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:30.100852 26964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:30.101040 26964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:30.103317 26964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "3d3e81b0afd14646b83e3fe850b6ec36"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "19dbe1b9abeac737192ae0387fa01136"
server_key_iv: "a8b12f044ea96c3993caffb0fd3561b3"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.103890 26964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "3d3e81b0afd14646b83e3fe850b6ec36"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "19dbe1b9abeac737192ae0387fa01136"
server_key_iv: "a8b12f044ea96c3993caffb0fd3561b3"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.107959 26964 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20260808 05:59:30.110745 26979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:30.112094 26964 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:59:30.112212 26964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "3d3e81b0afd14646b83e3fe850b6ec36"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "19dbe1b9abeac737192ae0387fa01136"
server_key_iv: "a8b12f044ea96c3993caffb0fd3561b3"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.112311 26964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:30.133096 26964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:30.136547 26964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:30.136771 26964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:30.144486 26964 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:42271
I20260808 05:59:30.144843 27037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:42271 every 8 connection(s)
I20260808 05:59:30.145617 26964 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:30.148501 27038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:30.150000 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 26964
I20260808 05:59:30.150166 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:30.150450 2813 external_mini_cluster.cc:1428] Setting key 33f1cb9381c0ed1d3300ca12558a3b1c
I20260808 05:59:30.152662 27038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.2.191.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.125@KRBTEST.COM" created.
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:59:30.169661 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.155305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42271 (local address 127.0.0.1:41522)
0808 05:59:30.155874 (+ 569us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.155930 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.156915 (+ 985us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.157779 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.157784 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.158164 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.158423 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.158437 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.160277 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.160280 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.161107 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.161117 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.161794 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.161798 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.161908 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.162628 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.162644 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.164198 (+ 1554us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.166475 (+ 2277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.166485 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.166495 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.166850 (+ 355us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.167257 (+ 407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.167259 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.167261 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.167375 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.168145 (+ 770us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.168151 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.168280 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.168425 (+ 145us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.168779 (+ 354us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"spinlock_wait_cycles":3968,"thread_start_us":181,"threads_started":1}
I20260808 05:59:30.169664 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.155306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41522 (local address 127.2.191.126:42271)
0808 05:59:30.155996 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.156009 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.156057 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:59:30.157275 (+ 1218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.157284 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.157550 (+ 266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.157791 (+ 241us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.158592 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.160107 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.161235 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.161628 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.161814 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.164362 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.164372 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.164390 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.164424 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.166354 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.166975 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.166984 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.166989 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.167156 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.167471 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.167477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.167482 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.168024 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.168195 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.168548 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.168864 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":120,"server-negotiator.queue_time_us":562,"spinlock_wait_cycles":29568,"thread_start_us":207,"threads_started":1}
I20260808 05:59:30.172240 27038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:30.173072 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.172804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58358)
0808 05:59:30.172930 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.173001 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 05:59:30.173267 26984 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
I20260808 05:59:30.174113 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.173905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58368)
0808 05:59:30.174013 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.174063 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 05:59:30.174275 27038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:41739: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab.
Entry for principal kudu/127.2.191.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab.
I20260808 05:59:30.184685 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.125:41739
--webserver_interface=127.2.191.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab
--principal=kudu/127.2.191.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:42271,127.2.191.125:41739,127.2.191.124:42331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:59:30.223558 27038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } attempt: 1
I20260808 05:59:30.224582 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.224233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58378)
0808 05:59:30.224408 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.224499 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 05:59:30.225391 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.225159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58386)
0808 05:59:30.225276 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.225332 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 05:59:30.225539 27038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:41739: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
I20260808 05:59:30.293705 27038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } attempt: 2
I20260808 05:59:30.294653 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.294339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58394)
0808 05:59:30.294502 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.294574 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 05:59:30.295382 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.295176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58408)
0808 05:59:30.295281 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.295334 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 05:59:30.295498 27038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:41739: Network error: Client connection negotiation failed: client connection to 127.2.191.125:41739: connect: Connection refused (error 111)
W20260808 05:59:30.300421 27047 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:59:30.300781 27047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:30.300848 27047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:30.300926 27047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:30.304967 27047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:30.305043 27047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:30.305089 27047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:30.305150 27047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:30.305187 27047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:30.310592 27047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:42271,127.2.191.125:41739,127.2.191.124:42331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab
--principal=kudu/127.2.191.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.125:41739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.191.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:30.311700 27047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:30.312785 27047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:30.321501 27053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:30.321640 27047 server_base.cc:1034] running on GCE node
W20260808 05:59:30.321494 27055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:30.321497 27052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:30.322355 27047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:30.323515 27047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:30.324849 27047 hybrid_clock.cc:648] HybridClock initialized: now 1786168770324815 us; error 26 us; skew 500 ppm
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:30.328158 27047 init.cc:377] Logged in from keytab as kudu/127.2.191.125@KRBTEST.COM (short username kudu)
I20260808 05:59:30.329358 27047 webserver.cc:460] Webserver started at http://127.2.191.125:34293/ using document root <none> and password file <none>
I20260808 05:59:30.330008 27047 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:30.330116 27047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:30.330379 27047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:30.332634 27047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/data/instance:
uuid: "38914392d61c449d9bed0f9bd10512ab"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "a66d6b7a57ccbd2450e3fc7319c39df6"
server_key_iv: "ee431b801aa41c4f23edd369426aa619"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.333356 27047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/wal/instance:
uuid: "38914392d61c449d9bed0f9bd10512ab"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "a66d6b7a57ccbd2450e3fc7319c39df6"
server_key_iv: "ee431b801aa41c4f23edd369426aa619"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.337575 27047 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20260808 05:59:30.340153 27062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:30.341576 27047 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:30.341728 27047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/wal
uuid: "38914392d61c449d9bed0f9bd10512ab"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "a66d6b7a57ccbd2450e3fc7319c39df6"
server_key_iv: "ee431b801aa41c4f23edd369426aa619"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.341854 27047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:30.355312 27047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:30.358340 27047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:30.358563 27047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:30.365839 27047 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.125:41739
I20260808 05:59:30.366160 27118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.125:41739 every 8 connection(s)
I20260808 05:59:30.366912 27047 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
I20260808 05:59:30.370039 27119 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:30.372268 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 27047
I20260808 05:59:30.372401 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-1/wal/instance
I20260808 05:59:30.372699 2813 external_mini_cluster.cc:1428] Setting key 8c4741507de6970e7ac9d65933e9b7dc
I20260808 05:59:30.375011 27119 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.2.191.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.124@KRBTEST.COM" created.
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:59:30.386674 27038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } attempt: 3
I20260808 05:59:30.390659 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.377185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41538 (local address 127.2.191.126:42271)
0808 05:59:30.377332 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.377336 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.378551 (+ 1215us) server_negotiation.cc:407] Connection header received
0808 05:59:30.379527 (+ 976us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.379531 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.379593 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.379705 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.380999 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.381552 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.382768 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.383125 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.383248 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.386222 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.386229 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.386235 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.386274 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.388157 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.388839 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.388845 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.388848 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.388995 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.389443 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.389450 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.389455 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.389662 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.389750 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.390349 (+ 599us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.390481 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:59:30.391798 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.377660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42271 (local address 127.0.0.1:41538)
0808 05:59:30.378284 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.378329 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.379287 (+ 958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.379873 (+ 586us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.379880 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.380230 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.380849 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.380866 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.381692 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.381695 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.382637 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.382646 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.383301 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.383305 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.383477 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.384020 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.384036 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.386020 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.388288 (+ 2268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.388294 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.388309 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.388707 (+ 398us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.389113 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.389116 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.389118 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.389302 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.389771 (+ 469us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.389777 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.390085 (+ 308us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.390271 (+ 186us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.390606 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":154,"threads_started":1}
I20260808 05:59:30.393404 27119 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
I20260808 05:59:30.399760 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.387176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58424)
0808 05:59:30.387397 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.387413 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.387489 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.388425 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.388429 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.388596 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.388773 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.388785 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.389982 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.389989 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.391056 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.391072 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.391844 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.391848 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.391960 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.392526 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.392542 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.395389 (+ 2847us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.397687 (+ 2298us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.397690 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.397692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.397949 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.398310 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.398315 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.398318 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.398439 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.399093 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.399096 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.399192 (+ 96us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.399288 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.399597 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128}
I20260808 05:59:30.399871 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.387349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58424 (local address 127.2.191.125:41739)
0808 05:59:30.387805 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.387819 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.387852 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:59:30.387906 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.387921 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.388269 (+ 348us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.388437 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.388906 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.389857 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.391201 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.391694 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.392202 (+ 508us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.395526 (+ 3324us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.395535 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.395573 (+ 38us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.395598 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.397572 (+ 1974us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.398085 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.398091 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.398093 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.398186 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.398549 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.398552 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.398554 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.398887 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.399029 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.399381 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.399499 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":231,"threads_started":1}
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
I20260808 05:59:30.402145 27038 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:30.403236 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.402821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49632)
0808 05:59:30.402970 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.403124 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 05:59:30.404110 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.403797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49636)
0808 05:59:30.403956 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.404028 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260808 05:59:30.404290 27038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:42331: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
I20260808 05:59:30.405578 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.394016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58438)
0808 05:59:30.394165 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.394182 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.394272 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.394733 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.394737 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.394940 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.395092 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.395102 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.396340 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.396346 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.397184 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.397194 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.397942 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.397946 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.398074 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.398657 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.398670 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.401835 (+ 3165us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.404071 (+ 2236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.404084 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.404086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.404313 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.404681 (+ 368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.404683 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.404685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.404814 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.405202 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.405204 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.405284 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.405358 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.405471 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71,"spinlock_wait_cycles":5376}
I20260808 05:59:30.405915 27125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.394104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58438 (local address 127.2.191.125:41739)
0808 05:59:30.394448 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.394454 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.394486 (+ 32us) server_negotiation.cc:407] Connection header received
0808 05:59:30.394523 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.394526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.394577 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.394679 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.395239 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.396208 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.397332 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.397778 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.397908 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.402134 (+ 4226us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.402137 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.402140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.402173 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.403950 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.404425 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.404429 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.404430 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.404594 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.404893 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.404895 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.404896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.405130 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.405212 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.405404 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.405603 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":282,"thread_start_us":139,"threads_started":1}
I20260808 05:59:30.406613 27119 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:30.407321 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.407025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49644)
0808 05:59:30.407129 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.407258 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab.
Entry for principal kudu/127.2.191.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab.
W20260808 05:59:30.407528 27065 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
I20260808 05:59:30.408439 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.124:42331
--webserver_interface=127.2.191.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab
--principal=kudu/127.2.191.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:40657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:42271,127.2.191.125:41739,127.2.191.124:42331
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:59:30.408530 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.408301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49660)
0808 05:59:30.408405 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.408451 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 05:59:30.408761 27119 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:42331: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
I20260808 05:59:30.435485 27038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } attempt: 1
I20260808 05:59:30.436393 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.436083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49662)
0808 05:59:30.436243 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.436312 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 05:59:30.437242 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.437019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49668)
0808 05:59:30.437141 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.437189 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260808 05:59:30.437461 27038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:42331: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
I20260808 05:59:30.458079 27119 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } attempt: 1
I20260808 05:59:30.459038 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.458713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49674)
0808 05:59:30.458886 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.458953 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260808 05:59:30.459779 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.459563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49682)
0808 05:59:30.459681 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.459726 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 05:59:30.459975 27119 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:42331: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
I20260808 05:59:30.512660 27038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } attempt: 2
I20260808 05:59:30.513602 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.513299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49696)
0808 05:59:30.513461 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.513527 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 05:59:30.514421 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.514122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49710)
0808 05:59:30.514298 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.514355 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
W20260808 05:59:30.514575 27038 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:42331: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
W20260808 05:59:30.526638 27127 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:59:30.526938 27127 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:30.526961 27127 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:30.527001 27127 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260808 05:59:30.528141 27119 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } attempt: 2
I20260808 05:59:30.529026 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.528702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49712)
0808 05:59:30.528874 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.528948 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260808 05:59:30.529773 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.529594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49728)
0808 05:59:30.529679 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.529721 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 05:59:30.529989 27119 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:42331: Network error: Client connection negotiation failed: client connection to 127.2.191.124:42331: connect: Connection refused (error 111)
W20260808 05:59:30.531641 27127 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:30.531697 27127 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:30.531740 27127 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:30.531776 27127 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:30.531826 27127 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:30.537371 27127 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:40657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:42271,127.2.191.125:41739,127.2.191.124:42331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab
--principal=kudu/127.2.191.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.124:42331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.191.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27127
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:30.538417 27127 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:30.539433 27127 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:30.548259 27133 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:30.548422 27127 server_base.cc:1034] running on GCE node
W20260808 05:59:30.548266 27135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:30.548316 27132 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:30.549178 27127 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:30.550436 27127 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:30.551668 27127 hybrid_clock.cc:648] HybridClock initialized: now 1786168770551639 us; error 41 us; skew 500 ppm
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:30.554507 27127 init.cc:377] Logged in from keytab as kudu/127.2.191.124@KRBTEST.COM (short username kudu)
I20260808 05:59:30.555454 27127 webserver.cc:460] Webserver started at http://127.2.191.124:34985/ using document root <none> and password file <none>
I20260808 05:59:30.556002 27127 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:30.556063 27127 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:30.556242 27127 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:30.558444 27127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/data/instance:
uuid: "ffd3c536785f4e5ba55cdcc9fe01df95"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "06573ec2e8943141c2cc8e8db755dab5"
server_key_iv: "458657cab0244e7c7323517dcd44a8d7"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.558997 27127 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/wal/instance:
uuid: "ffd3c536785f4e5ba55cdcc9fe01df95"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "06573ec2e8943141c2cc8e8db755dab5"
server_key_iv: "458657cab0244e7c7323517dcd44a8d7"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.562877 27127 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20260808 05:59:30.565466 27143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:30.566785 27127 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:30.566898 27127 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/wal
uuid: "ffd3c536785f4e5ba55cdcc9fe01df95"
format_stamp: "Formatted at 2026-08-08 05:59:30 on dist-test-slave-qg60"
server_key: "06573ec2e8943141c2cc8e8db755dab5"
server_key_iv: "458657cab0244e7c7323517dcd44a8d7"
server_key_version: "encryptionkey@0"
I20260808 05:59:30.567050 27127 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:30.598441 27127 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:30.601933 27127 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:30.602157 27127 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:30.609623 27127 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.124:42331
I20260808 05:59:30.609968 27203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.124:42331 every 8 connection(s)
I20260808 05:59:30.610670 27127 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
I20260808 05:59:30.613513 27204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:30.613736 27038 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } attempt: 3
I20260808 05:59:30.615988 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 27127
I20260808 05:59:30.616139 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786168478015505-2813-0/minicluster-data/master-2/wal/instance
I20260808 05:59:30.616492 2813 external_mini_cluster.cc:1428] Setting key 2c7d14e8c2be1b6be8e6a4a79d7ff09f
I20260808 05:59:30.619284 27204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:30.621160 27119 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } attempt: 3
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:59:30.631997 27042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.614312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49730)
0808 05:59:30.614489 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.614504 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.614612 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.618005 (+ 3393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.618010 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.618244 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.618378 (+ 134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.618386 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.620297 (+ 1911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.620301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.621186 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.621200 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.622314 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.622320 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.622417 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.623076 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.623105 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.625357 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.628999 (+ 3642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.629004 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.629006 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.629615 (+ 609us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.630260 (+ 645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.630263 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.630265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.630386 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.631406 (+ 1020us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.631409 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.631524 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.631612 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.631783 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260808 05:59:30.632467 27122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.621640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49756)
0808 05:59:30.621933 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.621950 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.622032 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.623290 (+ 1258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.623293 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.623496 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.623611 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.623619 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.624803 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.624807 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.625681 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.625693 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.626329 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.626334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.626461 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.626932 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.626948 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.628581 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.630799 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.630807 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.630811 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.631067 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.631410 (+ 343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.631413 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.631414 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.631509 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.631942 (+ 433us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.631945 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.632046 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.632147 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.632297 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217}
I20260808 05:59:30.633325 27206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.615190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49730 (local address 127.2.191.124:42331)
0808 05:59:30.615682 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.615720 (+ 38us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.615774 (+ 54us) server_negotiation.cc:407] Connection header received
0808 05:59:30.617013 (+ 1239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.617038 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.617623 (+ 585us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.618503 (+ 880us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.618823 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.620087 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.621343 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.622180 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.622350 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.625550 (+ 3200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.625556 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.625569 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.625614 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.628846 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.630023 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.630029 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.630033 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.630134 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.630504 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.630507 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.630510 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.631007 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.632199 (+ 1192us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.632288 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.632399 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":204,"server-negotiator.queue_time_us":331,"spinlock_wait_cycles":3712,"thread_start_us":197,"threads_started":1}
I20260808 05:59:30.633327 27207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.617248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49740 (local address 127.2.191.124:42331)
0808 05:59:30.617578 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.617598 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.617846 (+ 248us) server_negotiation.cc:407] Connection header received
0808 05:59:30.617990 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.617993 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.618035 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.618262 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.619035 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.620088 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.621343 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.622325 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.622405 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.625735 (+ 3330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.625742 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.625747 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.625779 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.628648 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.629300 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.629307 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.629314 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.629481 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.629829 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.629832 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.629834 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.630404 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.631447 (+ 1043us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.631631 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.631965 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":129,"server-negotiator.queue_time_us":243,"spinlock_wait_cycles":5504,"thread_start_us":134,"threads_started":1}
I20260808 05:59:30.633325 27210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.622168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49756 (local address 127.2.191.124:42331)
0808 05:59:30.622465 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.622474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.622489 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:59:30.622527 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.622530 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.622579 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.623742 (+ 1163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.623836 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.624642 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.625835 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.626193 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.626295 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.628792 (+ 2497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.628796 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.628798 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.628826 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.630671 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.631205 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.631208 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.631210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.631294 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.631635 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.631638 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.631640 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.631827 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.632790 (+ 963us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.632861 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.632982 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"spinlock_wait_cycles":2944,"thread_start_us":110,"threads_started":1}
I20260808 05:59:30.634711 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.622204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41548 (local address 127.2.191.126:42271)
0808 05:59:30.622724 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.622730 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.622889 (+ 159us) server_negotiation.cc:407] Connection header received
0808 05:59:30.623003 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.623007 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.623057 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.623147 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.624078 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.624821 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.626110 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.626415 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.626542 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.630243 (+ 3701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.630247 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.630250 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.630276 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.632015 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.633138 (+ 1123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.633142 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.633144 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.633233 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.633577 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.633581 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.633583 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.633882 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.633981 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.634403 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.634535 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"spinlock_wait_cycles":896}
I20260808 05:59:30.635394 27209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.621394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:42271 (local address 127.0.0.1:41548)
0808 05:59:30.622735 (+ 1341us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.622794 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.622930 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.623313 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.623318 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.623812 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.623949 (+ 137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.623955 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.624944 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.624950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.625949 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.625961 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.626545 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.626548 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.626684 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.628013 (+ 1329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.628030 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.630085 (+ 2055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.632424 (+ 2339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.632431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.632437 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.633015 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.633366 (+ 351us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.633372 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.633375 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.633468 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.634032 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.634038 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.634161 (+ 123us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.634960 (+ 799us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.635203 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1161,"spinlock_wait_cycles":4352,"thread_start_us":98,"threads_started":1}
I20260808 05:59:30.638077 27038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36: Bootstrap starting.
I20260808 05:59:30.638077 27119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab: Bootstrap starting.
I20260808 05:59:30.640331 27119 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:30.640332 27038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:30.641191 27119 log.cc:824] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:30.641407 27038 log.cc:824] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:30.641431 27204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:30.643584 27119 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab: No bootstrap required, opened a new log
I20260808 05:59:30.643816 27038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36: No bootstrap required, opened a new log
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
I20260808 05:59:30.648306 27119 raft_consensus.cc:348] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } }
I20260808 05:59:30.648310 27038 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } }
I20260808 05:59:30.648533 27038 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d3e81b0afd14646b83e3fe850b6ec36, State: Initialized, Role: FOLLOWER
I20260808 05:59:30.648535 27119 raft_consensus.cc:729] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38914392d61c449d9bed0f9bd10512ab, State: Initialized, Role: FOLLOWER
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:59:30.648897 27119 consensus_queue.cc:260] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } }
I20260808 05:59:30.648962 27038 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } }
I20260808 05:59:30.650491 27038 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:30.650490 27119 sys_catalog.cc:564] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:30.651283 27213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.651525 27213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:30.650661 27214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.653532 27209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.641973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:41739 (local address 127.0.0.1:58442)
0808 05:59:30.642697 (+ 724us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.642712 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.642838 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.643257 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.643260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.643438 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.643566 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.643574 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.644610 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.644615 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.645497 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.645509 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.646302 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.646306 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.646410 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.646854 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.646868 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.649561 (+ 2693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.651526 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.651532 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.651537 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.651820 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.652179 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.652182 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.652184 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.652290 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.652969 (+ 679us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.652971 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.653079 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.653202 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.653357 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603}
I20260808 05:59:30.654225 27125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.642066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58442 (local address 127.2.191.125:41739)
0808 05:59:30.642203 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.642207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.642771 (+ 564us) server_negotiation.cc:407] Connection header received
0808 05:59:30.642943 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.642947 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.642992 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.643043 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.643730 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.644449 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.645655 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.646013 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.646096 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.649734 (+ 3638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.649737 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.649740 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.649766 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.651379 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.651951 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.651954 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.651956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.652061 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.652443 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.652450 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.652452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.652808 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.652916 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.653965 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.654089 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:59:30.655004 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.636192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41556 (local address 127.2.191.126:42271)
0808 05:59:30.636881 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.636885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.642008 (+ 5123us) server_negotiation.cc:407] Connection header received
0808 05:59:30.642221 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.642227 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.642278 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.642360 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.643282 (+ 922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.644036 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.645261 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.645594 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.645709 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.649279 (+ 3570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.649283 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.649286 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.649314 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.652974 (+ 3660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.653512 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.653515 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.653517 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.653623 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.653961 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.653964 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.653966 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.654182 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.654354 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.654750 (+ 396us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.654867 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602}
I20260808 05:59:30.652400 27214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:30.655367 27204 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } has no permanent_uuid. Determining permanent_uuid...
W20260808 05:59:30.658988 27237 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:30.659107 27237 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168770, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
Aug 08 05:59:30 dist-test-slave-qg60 krb5kdc[26950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168769, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
I20260808 05:59:30.662053 26964 master_runner.cc:186] Error getting master registration for 127.2.191.124:42331: OK, instance_id { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" instance_seqno: 1786168770607561 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:59:30.665664 26964 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260808 05:59:30.666939 27238 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:30.667131 27238 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:30.667377 27209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.655896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:42331 (local address 127.0.0.1:49772)
0808 05:59:30.656154 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:30.656172 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:30.656249 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:30.658016 (+ 1767us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:30.658019 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:30.658203 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:30.658293 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.658299 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.659214 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.659217 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.659952 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:30.659962 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.660584 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.660590 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:30.660677 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.661173 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:30.661189 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:30.663353 (+ 2164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:30.665415 (+ 2062us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.665418 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.665420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.665658 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.665950 (+ 292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:30.665955 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:30.665958 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:30.666037 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:30.666828 (+ 791us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:30.666830 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:30.666909 (+ 79us) client_negotiation.cc:769] Sending connection context
0808 05:59:30.667024 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 05:59:30.667198 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188}
I20260808 05:59:30.667866 27206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.656257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49772 (local address 127.2.191.124:42331)
0808 05:59:30.656560 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.656564 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.656578 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:59:30.656615 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.656618 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.656659 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.656754 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.658407 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.659091 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.660054 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.660400 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.660487 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.663501 (+ 3014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.663507 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.663513 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.663538 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.665295 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.665764 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.665769 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.665774 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.665854 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.666140 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.666143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.666146 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.666702 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.666795 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.667584 (+ 789us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.667715 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234}
I20260808 05:59:30.665933 27047 master_runner.cc:186] Error getting master registration for 127.2.191.124:42331: OK, instance_id { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" instance_seqno: 1786168770607561 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:59:30.670193 27047 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:59:30.669945 27125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.656824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58452 (local address 127.2.191.125:41739)
0808 05:59:30.656979 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.656983 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.656995 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:59:30.657027 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.657030 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.657068 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.657139 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.658006 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.658774 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.659906 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.660220 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.660306 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.663567 (+ 3261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.663574 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.663580 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.663605 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.665999 (+ 2394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.668025 (+ 2026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.668029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.668030 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.668168 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.668514 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.668519 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.668521 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.668777 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.669003 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.669678 (+ 675us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.669801 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:59:30.672801 27204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95: Bootstrap starting.
I20260808 05:59:30.674078 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:30.675644 27009 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3d3e81b0afd14646b83e3fe850b6ec36"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41556
I20260808 05:59:30.675909 27204 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:30.675989 27009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 05:59:30.676124 27009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:30.676903 27204 log.cc:824] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:30.677596 27009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } }
I20260808 05:59:30.679138 27093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "38914392d61c449d9bed0f9bd10512ab"
I20260808 05:59:30.679406 27093 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:30.680843 27093 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3e81b0afd14646b83e3fe850b6ec36 in term 1.
I20260808 05:59:30.681327 26984 leader_election.cc:302] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38914392d61c449d9bed0f9bd10512ab, 3d3e81b0afd14646b83e3fe850b6ec36; no voters:
I20260808 05:59:30.681661 27214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:30.681905 27214 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [term 1 LEADER]: Becoming Leader. State: Replica: 3d3e81b0afd14646b83e3fe850b6ec36, State: Running, Role: LEADER
I20260808 05:59:30.682255 27214 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } }
I20260808 05:59:30.682747 27204 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95: No bootstrap required, opened a new log
I20260808 05:59:30.684007 27214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3e81b0afd14646b83e3fe850b6ec36. Latest consensus state: current_term: 1 leader_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.684134 27214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:30.684921 27009 leader_election.cc:288] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [CANDIDATE]: Term 1 election: Requested vote from peers 38914392d61c449d9bed0f9bd10512ab (127.2.191.125:41739), ffd3c536785f4e5ba55cdcc9fe01df95 (127.2.191.124:42331)
I20260808 05:59:30.687433 27204 raft_consensus.cc:348] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } }
I20260808 05:59:30.687693 27204 raft_consensus.cc:729] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffd3c536785f4e5ba55cdcc9fe01df95, State: Initialized, Role: FOLLOWER
I20260808 05:59:30.688027 27204 consensus_queue.cc:260] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } }
I20260808 05:59:30.689469 27204 sys_catalog.cc:564] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:30.689554 27175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95"
I20260808 05:59:30.689783 27175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:30.691190 27175 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3d3e81b0afd14646b83e3fe850b6ec36 in term 1.
I20260808 05:59:30.692463 27244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:30.692991 27249 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.693123 27249 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:59:30.696455 27261 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:30.696586 27261 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:30.700006 27244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:30.713186 27125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.688224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58464 (local address 127.2.191.125:41739)
0808 05:59:30.688449 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.688476 (+ 27us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.702917 (+ 14441us) server_negotiation.cc:407] Connection header received
0808 05:59:30.703408 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.703411 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.703463 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.703515 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.704892 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.705694 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.706885 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.707233 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.707306 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.709391 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.709396 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.709399 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.709427 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.711212 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.711726 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.711729 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.711731 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.711820 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.712140 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.712143 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.712145 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.712370 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.712485 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.712871 (+ 386us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.713003 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260808 05:59:30.719583 27206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.697731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49778 (local address 127.2.191.124:42331)
0808 05:59:30.697841 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.697846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.705016 (+ 7170us) server_negotiation.cc:407] Connection header received
0808 05:59:30.705230 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.705234 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.705287 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.705341 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.706436 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.707204 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.712851 (+ 5647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.713227 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.713308 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.715095 (+ 1787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.715100 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.715103 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.715145 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.717109 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.718166 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.718170 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.718172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.718263 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.718572 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.718576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.718577 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.718789 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.718903 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.719288 (+ 385us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.719414 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:59:30.720232 27175 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [term 1 FOLLOWER]: Refusing update from remote peer 3d3e81b0afd14646b83e3fe850b6ec36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:59:30.720703 27044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:30.688835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.2.191.126:42271)
0808 05:59:30.688957 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.688961 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.703123 (+ 14162us) server_negotiation.cc:407] Connection header received
0808 05:59:30.703676 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.703680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.703743 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.703809 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.712833 (+ 9024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.713597 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.714659 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:30.714974 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:30.715047 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:30.716858 (+ 1811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:30.716862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:30.716865 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:30.716896 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:30.718786 (+ 1890us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.719293 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.719296 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.719298 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.719392 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:30.719723 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:30.719727 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:30.719728 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:30.719944 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:30.720057 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:30.720421 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 05:59:30.720538 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:59:30.721073 27242 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:59:30.726593 27249 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3e81b0afd14646b83e3fe850b6ec36. Latest consensus state: current_term: 1 leader_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.726724 27249 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:30.727777 27093 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [term 1 FOLLOWER]: Refusing update from remote peer 3d3e81b0afd14646b83e3fe850b6ec36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:59:30.728720 27242 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:59:30.733114 27213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d3e81b0afd14646b83e3fe850b6ec36. Latest consensus state: current_term: 1 leader_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.733261 27213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:30.754274 27242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.754447 27242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:30.754882 27266 mvcc.cc:205] Tried to move back new op lower bound from 7316147284860657664 to 7316147284717838336. Current Snapshot: MvccSnapshot[applied={T|T < 7316147284860657664}]
I20260808 05:59:30.756325 27213 sys_catalog.cc:455] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.756866 27213 sys_catalog.cc:458] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:30.758332 27269 mvcc.cc:205] Tried to move back new op lower bound from 7316147284860657664 to 7316147284717838336. Current Snapshot: MvccSnapshot[applied={T|T < 7316147284860657664}]
I20260808 05:59:30.762259 27214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.762404 27214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:30.763784 27249 sys_catalog.cc:455] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3d3e81b0afd14646b83e3fe850b6ec36" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 42271 } } peers { permanent_uuid: "38914392d61c449d9bed0f9bd10512ab" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 41739 } } peers { permanent_uuid: "ffd3c536785f4e5ba55cdcc9fe01df95" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 42331 } } }
I20260808 05:59:30.763919 27249 sys_catalog.cc:458] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:30.764868 27267 mvcc.cc:205] Tried to move back new op lower bound from 7316147284860657664 to 7316147284717838336. Current Snapshot: MvccSnapshot[applied={T|T < 7316147284860657664}]
I20260808 05:59:30.770684 27244 catalog_manager.cc:1347] Generated new cluster ID: fca2d9a056ae426cbccab3005b70ae42
I20260808 05:59:30.770764 27244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:59:30.826695 27244 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:30.828222 27244 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:30.858384 27244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d3e81b0afd14646b83e3fe850b6ec36: Generated new TSK 0
I20260808 05:59:30.859375 27244 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:59:30.898976 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.896893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58480 (local address 127.2.191.125:41739)
0808 05:59:30.897057 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.897062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.897981 (+ 919us) server_negotiation.cc:407] Connection header received
0808 05:59:30.898170 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.898173 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.898218 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.898284 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.898837 (+ 553us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58480: BlockingRecv error: recv got EOF from 127.0.0.1:58480 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 05:59:30.898983 27044 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.897467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41566 (local address 127.2.191.126:42271)
0808 05:59:30.897589 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.897595 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.897871 (+ 276us) server_negotiation.cc:407] Connection header received
0808 05:59:30.898008 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.898011 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.898076 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.898163 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.898840 (+ 677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41566: BlockingRecv error: recv got EOF from 127.0.0.1:41566 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260808 05:59:30.899170 27206 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.897543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49794 (local address 127.2.191.124:42331)
0808 05:59:30.897704 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.897708 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.898177 (+ 469us) server_negotiation.cc:407] Connection header received
0808 05:59:30.898355 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.898358 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.898407 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.898461 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.899039 (+ 578us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49794: BlockingRecv error: recv got EOF from 127.0.0.1:49794 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260808 05:59:30.902666 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.901601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58482 (local address 127.2.191.125:41739)
0808 05:59:30.901718 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.901721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.901807 (+ 86us) server_negotiation.cc:407] Connection header received
0808 05:59:30.901948 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.901950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.902009 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.902079 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.902549 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58482: BlockingRecv error: recv got EOF from 127.0.0.1:58482 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 05:59:30.906720 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.905879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58488 (local address 127.2.191.125:41739)
0808 05:59:30.906003 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.906007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.906018 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:59:30.906059 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.906061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.906099 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.906191 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.906602 (+ 411us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58488: BlockingRecv error: recv got EOF from 127.0.0.1:58488 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 05:59:30.911582 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.910470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58502 (local address 127.2.191.125:41739)
0808 05:59:30.910578 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.910581 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.910788 (+ 207us) server_negotiation.cc:407] Connection header received
0808 05:59:30.910936 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.910939 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.910985 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.911075 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.911481 (+ 406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58502: BlockingRecv error: recv got EOF from 127.0.0.1:58502 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
W20260808 05:59:30.918589 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.917439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58510 (local address 127.2.191.125:41739)
0808 05:59:30.917844 (+ 405us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.917848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.917868 (+ 20us) server_negotiation.cc:407] Connection header received
0808 05:59:30.917921 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.917924 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.917966 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.918046 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.918466 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58510: BlockingRecv error: recv got EOF from 127.0.0.1:58510 (error 108)
Metrics: {"server-negotiator.queue_time_us":134}
W20260808 05:59:30.929646 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.928480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58524 (local address 127.2.191.125:41739)
0808 05:59:30.928656 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.928660 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.928706 (+ 46us) server_negotiation.cc:407] Connection header received
0808 05:59:30.928907 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.928910 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.928968 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.929041 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.929488 (+ 447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58524: BlockingRecv error: recv got EOF from 127.0.0.1:58524 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260808 05:59:30.948858 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.947659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58536 (local address 127.2.191.125:41739)
0808 05:59:30.947857 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.947861 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.947935 (+ 74us) server_negotiation.cc:407] Connection header received
0808 05:59:30.948056 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.948058 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.948110 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.948205 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.948746 (+ 541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58536: BlockingRecv error: recv got EOF from 127.0.0.1:58536 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 05:59:30.984148 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:30.983036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58550 (local address 127.2.191.125:41739)
0808 05:59:30.983201 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:30.983205 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:30.983331 (+ 126us) server_negotiation.cc:407] Connection header received
0808 05:59:30.983458 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:30.983461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:30.983513 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:30.983604 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:30.984037 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58550: BlockingRecv error: recv got EOF from 127.0.0.1:58550 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260808 05:59:31.051802 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:31.050440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.2.191.125:41739)
0808 05:59:31.050611 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:31.050621 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:31.050758 (+ 137us) server_negotiation.cc:407] Connection header received
0808 05:59:31.050886 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:31.050889 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:31.050941 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:31.051152 (+ 211us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:31.051674 (+ 522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58562: BlockingRecv error: recv got EOF from 127.0.0.1:58562 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260808 05:59:31.183310 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:31.182162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58574 (local address 127.2.191.125:41739)
0808 05:59:31.182327 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:31.182330 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:31.182455 (+ 125us) server_negotiation.cc:407] Connection header received
0808 05:59:31.182585 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:31.182588 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:31.182637 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:31.182720 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:31.183164 (+ 444us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58574: BlockingRecv error: recv got EOF from 127.0.0.1:58574 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260808 05:59:31.443082 27125 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:31.441761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58576 (local address 127.2.191.125:41739)
0808 05:59:31.442037 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:31.442042 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:31.442061 (+ 19us) server_negotiation.cc:407] Connection header received
0808 05:59:31.442240 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:31.442243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:31.442301 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:31.442386 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:31.442920 (+ 534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58576: BlockingRecv error: recv got EOF from 127.0.0.1:58576 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
I20260808 05:59:31.668581 27238 catalog_manager.cc:1259] Loaded cluster ID: fca2d9a056ae426cbccab3005b70ae42
I20260808 05:59:31.668700 27238 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab: loading cluster ID for follower catalog manager: success
I20260808 05:59:31.670526 27238 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab: acquiring CA information for follower catalog manager: success
I20260808 05:59:31.671767 27238 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 38914392d61c449d9bed0f9bd10512ab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:59:31.697930 27261 catalog_manager.cc:1259] Loaded cluster ID: fca2d9a056ae426cbccab3005b70ae42
I20260808 05:59:31.698019 27261 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95: loading cluster ID for follower catalog manager: success
I20260808 05:59:31.699679 27261 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95: acquiring CA information for follower catalog manager: success
I20260808 05:59:31.700881 27261 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ffd3c536785f4e5ba55cdcc9fe01df95: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:59:31.961833 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:31.957355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58580 (local address 127.2.191.125:41739)
0808 05:59:31.957645 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:31.957660 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:31.957767 (+ 107us) server_negotiation.cc:407] Connection header received
0808 05:59:31.957954 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:31.957960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:31.958093 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:31.958224 (+ 131us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:31.958543 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.959190 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.960291 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.960517 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.960608 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:31.960912 (+ 304us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:31.961360 (+ 448us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:31.961455 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:31.961567 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 05:59:31.961643 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":78,"threads_started":1}
I20260808 05:59:31.968492 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:31.964874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49796 (local address 127.2.191.124:42331)
0808 05:59:31.965203 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:31.965207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:31.965220 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:59:31.965299 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:31.965301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:31.965413 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:31.965512 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:31.965847 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.966362 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.967139 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.967357 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.967434 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:31.967721 (+ 287us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:31.968145 (+ 424us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:31.968243 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:31.968303 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 05:59:31.968355 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":156,"threads_started":1}
I20260808 05:59:31.976001 27352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:31.972148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49804 (local address 127.2.191.124:42331)
0808 05:59:31.972281 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:31.972285 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:31.972509 (+ 224us) server_negotiation.cc:407] Connection header received
0808 05:59:31.972695 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:31.972698 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:31.972773 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:31.972822 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:31.973176 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.973929 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.974899 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.975137 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.975247 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:31.975510 (+ 263us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:31.975605 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:31.975676 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:31.975785 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 05:59:31.975840 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:59:31.976222 27345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:31.971758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58594 (local address 127.2.191.125:41739)
0808 05:59:31.971929 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:31.971936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:31.972397 (+ 461us) server_negotiation.cc:407] Connection header received
0808 05:59:31.972503 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:31.972506 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:31.972611 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:31.972686 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:31.973023 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.973825 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.974938 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.975277 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.975373 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:31.975718 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:31.975791 (+ 73us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:31.975867 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:31.976028 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 05:59:31.976084 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:59:31.976399 27359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:31.971709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41580 (local address 127.2.191.126:42271)
0808 05:59:31.972103 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:31.972108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:31.972125 (+ 17us) server_negotiation.cc:407] Connection header received
0808 05:59:31.972238 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:31.972242 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:31.972438 (+ 196us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:31.972570 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:31.972816 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.973478 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.974585 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:31.974950 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:31.975040 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:31.975440 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:31.975795 (+ 355us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:31.975883 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:31.976187 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 05:59:31.976256 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":85,"threads_started":1}
I20260808 05:59:31.979801 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 26964
I20260808 05:59:31.989005 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 27047
I20260808 05:59:31.997344 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 27127
2026-08-08T05:59:32Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3321 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:59:32 dist-test-slave-qg60 krb5kdc[27363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:59:32 dist-test-slave-qg60 krb5kdc[27363](info): set up 2 sockets
Aug 08 05:59:32 dist-test-slave-qg60 krb5kdc[27363](info): commencing operation
krb5kdc: starting...
W20260808 05:59:33.105917 2813 mini_kdc.cc:121] Time spent starting KDC: real 1.083s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/test-user.keytab.
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:59:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:59:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.2.191.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
Entry for principal kudu/127.2.191.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab.
I20260808 05:59:33.248257 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:40845
--webserver_interface=127.2.191.126
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:35183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:40845,127.2.191.125:40107,127.2.191.124:40085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:59:33.366190 27376 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:59:33.366520 27376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:33.366546 27376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:33.366658 27376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:33.371263 27376 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:33.371346 27376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:33.371367 27376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:33.371384 27376 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:33.371400 27376 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:33.377266 27376 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:35183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:40845,127.2.191.125:40107,127.2.191.124:40085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.126.keytab
--principal=kudu/127.2.191.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.126:40845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.2.191.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:33.378552 27376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:33.379689 27376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:59:33.389147 27376 server_base.cc:1034] running on GCE node
W20260808 05:59:33.389101 27382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:33.389104 27387 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:33.389104 27383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:33.390056 27376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:33.391242 27376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:33.392406 27376 hybrid_clock.cc:648] HybridClock initialized: now 1786168773392390 us; error 30 us; skew 500 ppm
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:33.400677 27376 init.cc:377] Logged in from keytab as kudu/127.2.191.126@KRBTEST.COM (short username kudu)
I20260808 05:59:33.401859 27376 webserver.cc:460] Webserver started at http://127.2.191.126:43949/ using document root <none> and password file <none>
I20260808 05:59:33.402505 27376 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:33.402602 27376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:33.402824 27376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:33.405098 27376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/data/instance:
uuid: "9af19afb56eb457e97ac2dae0a8b63c7"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "d791896de756753a5cc4c0f8457dab2e"
server_key_iv: "2c80289a325f5f9daa2a7e6eb2cd9aed"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.405694 27376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/wal/instance:
uuid: "9af19afb56eb457e97ac2dae0a8b63c7"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "d791896de756753a5cc4c0f8457dab2e"
server_key_iv: "2c80289a325f5f9daa2a7e6eb2cd9aed"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.409646 27376 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20260808 05:59:33.412242 27394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:33.413534 27376 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20260808 05:59:33.413694 27376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/wal
uuid: "9af19afb56eb457e97ac2dae0a8b63c7"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "d791896de756753a5cc4c0f8457dab2e"
server_key_iv: "2c80289a325f5f9daa2a7e6eb2cd9aed"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.413818 27376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:33.424878 27376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:33.428434 27376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:33.428663 27376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:33.436471 27376 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.126:40845
I20260808 05:59:33.436894 27450 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.126:40845 every 8 connection(s)
I20260808 05:59:33.437561 27376 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/data/info.pb
I20260808 05:59:33.440840 27451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:33.445286 27451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:33.446130 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 27376
I20260808 05:59:33.446274 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-0/wal/instance
I20260808 05:59:33.446610 2813 external_mini_cluster.cc:1428] Setting key fdbba347cd7c5f1076eeead26f578104
WARNING: no policy specified for kudu/127.2.191.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.125@KRBTEST.COM" created.
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:59:33.467651 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.448112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40845 (local address 127.0.0.1:49370)
0808 05:59:33.448652 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.448711 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:33.449755 (+ 1044us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:33.450599 (+ 844us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:33.450607 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:33.451116 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:33.451524 (+ 408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.451546 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.452870 (+ 1324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.452874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.454269 (+ 1395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.454281 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.455034 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.455041 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.455182 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.455854 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:33.455879 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:33.461262 (+ 5383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:33.464139 (+ 2877us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.464151 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.464163 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.464436 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.464889 (+ 453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.464894 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.464896 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.465026 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.465717 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:33.465724 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:33.465883 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 05:59:33.466075 (+ 192us) client_negotiation.cc:240] Negotiation successful
0808 05:59:33.466538 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":113,"thread_start_us":153,"threads_started":1}
I20260808 05:59:33.467651 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.449115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49370 (local address 127.2.191.126:40845)
0808 05:59:33.449512 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.449533 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.449599 (+ 66us) server_negotiation.cc:407] Connection header received
0808 05:59:33.450097 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.450106 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.450371 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.450544 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.451703 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.452686 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.454410 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.454848 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.454991 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.461464 (+ 6473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.461472 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.461486 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.461514 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.463979 (+ 2465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.464567 (+ 588us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.464574 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.464576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.464779 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.465129 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.465134 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.465136 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.465583 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.465738 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.466161 (+ 423us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.466445 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":261,"thread_start_us":107,"threads_started":1}
I20260808 05:59:33.471163 27451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:33.472085 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.471738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33234)
0808 05:59:33.471908 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.471991 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
W20260808 05:59:33.472463 27396 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
I20260808 05:59:33.473497 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.473240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33246)
0808 05:59:33.473365 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.473415 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260808 05:59:33.473697 27451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:40107: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab.
Entry for principal kudu/127.2.191.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab.
I20260808 05:59:33.480966 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.125:40107
--webserver_interface=127.2.191.125
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab
--principal=kudu/127.2.191.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:35183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:40845,127.2.191.125:40107,127.2.191.124:40085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:59:33.522995 27451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } attempt: 1
I20260808 05:59:33.524147 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.523758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33256)
0808 05:59:33.523958 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.524042 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260808 05:59:33.525024 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.524770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33272)
0808 05:59:33.524886 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.524953 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 05:59:33.525174 27451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:40107: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
I20260808 05:59:33.593364 27451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } attempt: 2
I20260808 05:59:33.594339 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.593971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33286)
0808 05:59:33.594165 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.594244 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 05:59:33.595140 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.594887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33292)
0808 05:59:33.595014 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.595074 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260808 05:59:33.595286 27451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.125:40107: Network error: Client connection negotiation failed: client connection to 127.2.191.125:40107: connect: Connection refused (error 111)
W20260808 05:59:33.603664 27458 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:59:33.603961 27458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:33.604053 27458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:33.604151 27458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:33.608349 27458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:33.608418 27458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:33.608438 27458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:33.608496 27458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:33.608525 27458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:33.614610 27458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:35183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:40845,127.2.191.125:40107,127.2.191.124:40085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.125.keytab
--principal=kudu/127.2.191.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.125:40107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.2.191.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:33.615800 27458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:33.616969 27458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:33.626101 27463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:33.626151 27465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:33.626101 27467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:33.626211 27458 server_base.cc:1034] running on GCE node
I20260808 05:59:33.626915 27458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:33.628127 27458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:33.629309 27458 hybrid_clock.cc:648] HybridClock initialized: now 1786168773629292 us; error 29 us; skew 500 ppm
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:33.632320 27458 init.cc:377] Logged in from keytab as kudu/127.2.191.125@KRBTEST.COM (short username kudu)
I20260808 05:59:33.633284 27458 webserver.cc:460] Webserver started at http://127.2.191.125:39667/ using document root <none> and password file <none>
I20260808 05:59:33.633857 27458 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:33.633944 27458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:33.634184 27458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:33.636334 27458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/data/instance:
uuid: "9cc1a0c1f9ac4c248ea21f66a1671571"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "0d373d012785c92bff1000db31eb3c17"
server_key_iv: "6713267b9c6176159113b81c0d049e59"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.636991 27458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/wal/instance:
uuid: "9cc1a0c1f9ac4c248ea21f66a1671571"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "0d373d012785c92bff1000db31eb3c17"
server_key_iv: "6713267b9c6176159113b81c0d049e59"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.641203 27458 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20260808 05:59:33.643805 27476 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:33.645161 27458 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260808 05:59:33.645303 27458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/wal
uuid: "9cc1a0c1f9ac4c248ea21f66a1671571"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "0d373d012785c92bff1000db31eb3c17"
server_key_iv: "6713267b9c6176159113b81c0d049e59"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.645426 27458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:33.668877 27458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:33.672405 27458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:33.672626 27458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:33.680269 27458 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.125:40107
I20260808 05:59:33.680564 27530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.125:40107 every 8 connection(s)
I20260808 05:59:33.681450 27458 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/data/info.pb
I20260808 05:59:33.684592 27531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:33.686472 27451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } attempt: 3
I20260808 05:59:33.689404 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 27458
I20260808 05:59:33.689575 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-1/wal/instance
I20260808 05:59:33.689858 2813 external_mini_cluster.cc:1428] Setting key 271d172b0dafe301d53a2af11bc1163d
I20260808 05:59:33.689646 27531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.2.191.124@KRBTEST.COM; defaulting to no policy
I20260808 05:59:33.702383 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.687098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33308)
0808 05:59:33.687283 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.687303 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:33.687409 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:33.690320 (+ 2911us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:33.690327 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:33.690555 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:33.690773 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.690785 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.692716 (+ 1931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.692722 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.693652 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.693662 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.694870 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.694874 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.694990 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.695671 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:33.695688 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:33.697258 (+ 1570us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:33.699452 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.699455 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.699457 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.699901 (+ 444us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.700352 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.700356 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.700358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.700480 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.701848 (+ 1368us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:33.701852 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:33.701961 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 05:59:33.702050 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:59:33.702213 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 05:59:33.704124 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.691884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49380 (local address 127.2.191.126:40845)
0808 05:59:33.692017 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.692022 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.692446 (+ 424us) server_negotiation.cc:407] Connection header received
0808 05:59:33.692693 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.692699 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.692790 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.692858 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.693778 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.694290 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.695394 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.695729 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.695840 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.699403 (+ 3563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.699410 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.699415 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.699444 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.701155 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.701816 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.701823 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.701828 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.701915 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.702258 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.702265 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.702270 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.702732 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.702814 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.703876 (+ 1062us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.704002 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":54}
I20260808 05:59:33.704526 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.687858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33308 (local address 127.2.191.125:40107)
0808 05:59:33.688341 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.688363 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.688411 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:59:33.689438 (+ 1027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.689464 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.689939 (+ 475us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.690371 (+ 432us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.690962 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.692537 (+ 1575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.693810 (+ 1273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.694713 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.694925 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.697411 (+ 2486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.697416 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.697426 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.697448 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.699326 (+ 1878us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.700035 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.700043 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.700051 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.700202 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.700562 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.701240 (+ 678us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.701244 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.701701 (+ 457us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.702647 (+ 946us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.702850 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.703315 (+ 465us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317,"spinlock_wait_cycles":896,"thread_start_us":112,"threads_started":1}
I20260808 05:59:33.704558 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.691836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40845 (local address 127.0.0.1:49380)
0808 05:59:33.692306 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.692362 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:33.692553 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:33.693033 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:33.693041 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:33.693437 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:33.693643 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.693656 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.694414 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.694418 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.695270 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.695280 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.695944 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.695952 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.696108 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.696792 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:33.696823 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:33.699230 (+ 2407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:33.701284 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.701298 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.701306 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.701687 (+ 381us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.702027 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.702033 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.702036 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.702125 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.702838 (+ 713us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:33.702844 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:33.702957 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 05:59:33.703156 (+ 199us) client_negotiation.cc:240] Negotiation successful
0808 05:59:33.703372 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"mutex_wait_us":43,"thread_start_us":190,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.2.191.124@KRBTEST.COM" created.
I20260808 05:59:33.706175 27531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:33.706951 27451 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:33.707719 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.707459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39652)
0808 05:59:33.707590 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.707651 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260808 05:59:33.708592 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.708315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39656)
0808 05:59:33.708493 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.708539 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260808 05:59:33.708806 27451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:40085: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
I20260808 05:59:33.716652 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.706778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33316 (local address 127.2.191.125:40107)
0808 05:59:33.706890 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.706895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.708023 (+ 1128us) server_negotiation.cc:407] Connection header received
0808 05:59:33.708133 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.708137 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.708195 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.708285 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.708858 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.709477 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.710260 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.710694 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.710832 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.713350 (+ 2518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.713354 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.713355 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.713378 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.714876 (+ 1498us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.715411 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.715414 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.715415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.715494 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.715823 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.715825 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.715826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.716010 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.716089 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.716403 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.716517 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:59:33.716907 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.706737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33316)
0808 05:59:33.707924 (+ 1187us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.707940 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:33.708047 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:33.708320 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:33.708325 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:33.708567 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:33.708702 (+ 135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.708711 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.709603 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.709606 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.710133 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.710142 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.710843 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.710847 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.710921 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.711498 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:33.711513 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:33.713197 (+ 1684us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:33.715011 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.715015 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.715019 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.715298 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.715605 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.715609 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.715611 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.715715 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.716121 (+ 406us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:33.716126 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:33.716236 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 05:59:33.716360 (+ 124us) client_negotiation.cc:240] Negotiation successful
0808 05:59:33.716637 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1109,"mutex_wait_us":88}
I20260808 05:59:33.717792 27531 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:33.718726 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.718415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39666)
0808 05:59:33.718566 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.718668 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260808 05:59:33.719344 27479 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
I20260808 05:59:33.720326 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.720108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39672)
0808 05:59:33.720223 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.720273 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260808 05:59:33.720516 27531 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:40085: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.2.191.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab.
Entry for principal kudu/127.2.191.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab.
I20260808 05:59:33.728528 2813 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
/tmp/dist-test-tasklOEsuG/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.124:40085
--webserver_interface=127.2.191.124
--webserver_port=0
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab
--principal=kudu/127.2.191.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.2.191.84:35183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.2.191.126:40845,127.2.191.125:40107,127.2.191.124:40085
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:59:33.739985 27451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } attempt: 1
I20260808 05:59:33.741020 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.740635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39684)
0808 05:59:33.740866 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.740934 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 05:59:33.741770 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.741534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39692)
0808 05:59:33.741652 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.741712 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 05:59:33.741906 27451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:40085: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
I20260808 05:59:33.769891 27531 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } attempt: 1
I20260808 05:59:33.770991 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.770666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39694)
0808 05:59:33.770836 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.770906 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260808 05:59:33.771898 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.771640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39704)
0808 05:59:33.771767 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.771830 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 05:59:33.772051 27531 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:40085: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
I20260808 05:59:33.817191 27451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } attempt: 2
I20260808 05:59:33.818149 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.817819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39712)
0808 05:59:33.817990 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.818063 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 05:59:33.819054 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.818817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39728)
0808 05:59:33.818940 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.818995 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 05:59:33.819216 27451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:40085: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
I20260808 05:59:33.840245 27531 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } attempt: 2
I20260808 05:59:33.841274 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.840906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39742)
0808 05:59:33.841092 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.841192 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260808 05:59:33.842065 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.841836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39750)
0808 05:59:33.841951 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.842007 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260808 05:59:33.842202 27531 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:40085: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
W20260808 05:59:33.849893 27539 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:59:33.850225 27539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:59:33.850250 27539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:59:33.850330 27539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:59:33.854539 27539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:59:33.854605 27539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:59:33.854626 27539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:59:33.854643 27539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:59:33.854658 27539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:59:33.860437 27539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.2.191.84:35183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.2.191.126:40845,127.2.191.125:40107,127.2.191.124:40085
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/krb5kdc/kudu_127.2.191.124.keytab
--principal=kudu/127.2.191.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.2.191.124:40085
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.2.191.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type DEBUG
built by systest at 08 Aug 2026 05:27:34 UTC on ccycloud.quasar-rquzrl.root.comops.site
build id 4574260
I20260808 05:59:33.861634 27539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:59:33.862659 27539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:59:33.872058 27545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:33.872151 27539 server_base.cc:1034] running on GCE node
W20260808 05:59:33.872069 27544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:59:33.872092 27547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:59:33.873167 27539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:59:33.874500 27539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:59:33.875718 27539 hybrid_clock.cc:648] HybridClock initialized: now 1786168773875699 us; error 36 us; skew 500 ppm
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:59:33.879137 27539 init.cc:377] Logged in from keytab as kudu/127.2.191.124@KRBTEST.COM (short username kudu)
I20260808 05:59:33.880112 27539 webserver.cc:460] Webserver started at http://127.2.191.124:37641/ using document root <none> and password file <none>
I20260808 05:59:33.880712 27539 fs_manager.cc:359] Metadata directory not provided
I20260808 05:59:33.880863 27539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:59:33.881088 27539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:59:33.883405 27539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/data/instance:
uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "a4e174b498225e716153f0c023b8e3df"
server_key_iv: "e68e42817cd9a7ce3979551d5ac6a501"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.884033 27539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/wal/instance:
uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "a4e174b498225e716153f0c023b8e3df"
server_key_iv: "e68e42817cd9a7ce3979551d5ac6a501"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.888370 27539 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.004s sys 0.003s
I20260808 05:59:33.891227 27554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:59:33.892620 27539 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260808 05:59:33.892804 27539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/data,/tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/wal
uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7"
format_stamp: "Formatted at 2026-08-08 05:59:33 on dist-test-slave-qg60"
server_key: "a4e174b498225e716153f0c023b8e3df"
server_key_iv: "e68e42817cd9a7ce3979551d5ac6a501"
server_key_version: "encryptionkey@0"
I20260808 05:59:33.892927 27539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:59:33.910360 27539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:59:33.913841 27539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:59:33.914059 27539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:59:33.918390 27451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } attempt: 3
I20260808 05:59:33.919425 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.918974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39754)
0808 05:59:33.919244 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.919316 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132}
I20260808 05:59:33.920297 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.920047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39764)
0808 05:59:33.920164 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.920214 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260808 05:59:33.920450 27451 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.2.191.124:40085: Network error: Client connection negotiation failed: client connection to 127.2.191.124:40085: connect: Connection refused (error 111)
I20260808 05:59:33.922156 27539 rpc_server.cc:307] RPC server started. Bound to: 127.2.191.124:40085
I20260808 05:59:33.922410 27612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.2.191.124:40085 every 8 connection(s)
I20260808 05:59:33.923291 27539 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/data/info.pb
I20260808 05:59:33.926353 27613 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:59:33.927052 2813 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu as pid 27539
I20260808 05:59:33.927193 2813 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasklOEsuG/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786168478015505-2813-0/minicluster-data/master-2/wal/instance
I20260808 05:59:33.927512 2813 external_mini_cluster.cc:1428] Setting key 8ecb5e9eb208745b4b79daea0992c9f5
I20260808 05:59:33.930951 27613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:33.933368 27531 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } attempt: 3
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.125@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
I20260808 05:59:33.944798 27616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.929032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39768 (local address 127.2.191.124:40085)
0808 05:59:33.929484 (+ 452us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.929504 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.929542 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:59:33.930206 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.930223 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.930597 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.930884 (+ 287us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.931901 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.933366 (+ 1465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.934653 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.935370 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.935554 (+ 184us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.938720 (+ 3166us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.938728 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.938745 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.938767 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.941223 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.941755 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.941761 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.941768 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.941889 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.942193 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.942198 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.942200 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.942755 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.942966 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.943290 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.943611 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":301,"thread_start_us":152,"threads_started":1}
I20260808 05:59:33.944897 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.933008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49384 (local address 127.2.191.126:40845)
0808 05:59:33.933182 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.933187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.933514 (+ 327us) server_negotiation.cc:407] Connection header received
0808 05:59:33.933773 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.933777 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.933833 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.933889 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.934822 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.935406 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.936601 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.936991 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.937119 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.940442 (+ 3323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.940446 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.940449 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.940481 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.942551 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.943257 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.943263 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.943267 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.943388 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.943773 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.943777 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.943778 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.943997 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.944101 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.944568 (+ 467us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.944705 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:59:33.945024 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.932959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.126:40845 (local address 127.0.0.1:49384)
0808 05:59:33.933379 (+ 420us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.933433 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:33.933610 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:33.934082 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:33.934086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:33.934495 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:33.934678 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.934688 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.935551 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.935554 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.936459 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.936470 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.937161 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.937165 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.937382 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.938073 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:33.938099 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:33.940261 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:33.942701 (+ 2440us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.942715 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.942724 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.943111 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.943545 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.943551 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.943553 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.943659 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.944133 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:33.944143 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:33.944290 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 05:59:33.944475 (+ 185us) client_negotiation.cc:240] Negotiation successful
0808 05:59:33.944689 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"mutex_wait_us":78,"thread_start_us":132,"threads_started":1}
I20260808 05:59:33.946424 27613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:33.946534 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.933805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39772)
0808 05:59:33.933970 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.933987 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:33.934071 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:33.934760 (+ 689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:33.934764 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:33.934979 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:33.935097 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.935105 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.936144 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.936150 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.936867 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.936879 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.937914 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.937918 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.938005 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.938538 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:33.938553 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:33.940520 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:33.943820 (+ 3300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.943824 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.943826 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.944099 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.944399 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.944404 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.944408 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.944542 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.945951 (+ 1409us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:33.945954 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:33.946070 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 05:59:33.946187 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 05:59:33.946341 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 05:59:33.946960 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.934208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39772 (local address 127.2.191.124:40085)
0808 05:59:33.934507 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.934516 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.934530 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:59:33.934562 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.934564 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.934599 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.934697 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.935233 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.935990 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.937012 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.937503 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.937641 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.940699 (+ 3058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.940705 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.940708 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.940771 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.943677 (+ 2906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.944196 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.944199 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.944201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.944287 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.944666 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.944671 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.944673 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.945836 (+ 1163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.945946 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.946282 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.946417 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":234,"thread_start_us":100,"threads_started":1}
I20260808 05:59:33.950711 27531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: Bootstrap starting.
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.126@KRBTEST.COM
I20260808 05:59:33.953851 27531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:33.954948 27531 log.cc:824] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:33.957176 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.947073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33322 (local address 127.2.191.125:40107)
0808 05:59:33.947184 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.947188 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.947280 (+ 92us) server_negotiation.cc:407] Connection header received
0808 05:59:33.947474 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.947477 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.947530 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.947592 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.948193 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.948959 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.949998 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.950387 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.950500 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.952847 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.952855 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.952862 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.952897 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.954790 (+ 1893us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.955652 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.955660 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.955665 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.955763 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.956163 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.956167 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.956169 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.956458 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.956583 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.956898 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.957014 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:59:33.957191 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.946986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.125:40107 (local address 127.0.0.1:33322)
0808 05:59:33.947196 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.947213 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:33.947349 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:33.947753 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:33.947758 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:33.947957 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:33.948061 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.948067 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.949060 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.949063 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.949884 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.949894 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.950512 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.950516 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.950617 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.951145 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:33.951160 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:33.952662 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:33.954922 (+ 2260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.954926 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.954928 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.955503 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.955927 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.955934 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.955939 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.956048 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.956572 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:33.956575 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:33.956682 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 05:59:33.956840 (+ 158us) client_negotiation.cc:240] Negotiation successful
0808 05:59:33.956997 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260808 05:59:33.957858 27613 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:59:33.958439 27531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: No bootstrap required, opened a new log
I20260808 05:59:33.958480 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.947459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49396 (local address 127.2.191.126:40845)
0808 05:59:33.947562 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.947566 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.947691 (+ 125us) server_negotiation.cc:407] Connection header received
0808 05:59:33.947978 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.947981 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.948030 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.948096 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.948983 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.949630 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.950827 (+ 1197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.951137 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.951267 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.954219 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.954223 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.954229 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.954259 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.955889 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.956432 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.956435 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.956437 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.956545 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.956964 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.956968 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.956969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.957223 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.957486 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.958182 (+ 696us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.958316 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:59:33.963301 27531 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } }
I20260808 05:59:33.963658 27531 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cc1a0c1f9ac4c248ea21f66a1671571, State: Initialized, Role: FOLLOWER
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.124@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
I20260808 05:59:33.964119 27531 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } }
I20260808 05:59:33.964771 27620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:33.964958 27620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [sys.catalog]: This master's current role is: FOLLOWER
Aug 08 05:59:33 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.2.191.125@KRBTEST.COM
I20260808 05:59:33.965898 27531 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:33.968200 27617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.958397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39786)
0808 05:59:33.958489 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:33.958503 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:33.958577 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:33.959289 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:33.959292 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:33.959477 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:33.959586 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.959594 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.960715 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.960718 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.961662 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:33.961673 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.962297 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.962301 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:33.962388 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.962932 (+ 544us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:33.962943 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:33.964368 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:33.966417 (+ 2049us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.966420 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.966422 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.966717 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.967004 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:33.967009 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:33.967011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:33.967100 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:33.967658 (+ 558us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:33.967663 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:33.967760 (+ 97us) client_negotiation.cc:769] Sending connection context
0808 05:59:33.967862 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 05:59:33.968007 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:59:33.968713 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.958529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39786 (local address 127.2.191.124:40085)
0808 05:59:33.958923 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.958928 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.958942 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:59:33.958981 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.958984 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.959030 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.959114 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.959716 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.960588 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.961797 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.962179 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.962305 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.964480 (+ 2175us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.964484 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.964486 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.964509 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.966280 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.966833 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.966838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.966841 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.966925 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.967193 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.967199 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.967203 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.967505 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.967607 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.968409 (+ 802us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.968536 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":315}
I20260808 05:59:33.970549 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:33.959654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33334 (local address 127.2.191.125:40107)
0808 05:59:33.959789 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:33.959792 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:33.959949 (+ 157us) server_negotiation.cc:407] Connection header received
0808 05:59:33.960150 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:33.960153 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:33.960195 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:33.960285 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:33.960943 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.961429 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.962197 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:33.962505 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:33.962611 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:33.966051 (+ 3440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:33.966058 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:33.966063 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:33.966096 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:33.967885 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.968507 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.968511 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.968513 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.968593 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:33.969211 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:33.969217 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:33.969221 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:33.969436 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:33.970217 (+ 781us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:33.970296 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 05:59:33.970408 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
W20260808 05:59:33.972249 27633 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:33.972323 27633 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:33.972288 27613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: Bootstrap starting.
I20260808 05:59:33.973779 2813 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:59:33.970273 27458 master_runner.cc:186] Error getting master registration for 127.2.191.126:40845: OK, instance_id { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" instance_seqno: 1786168773434320 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:59:33.974578 27458 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:59:33.975399 27613 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:33.975031 27422 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "9af19afb56eb457e97ac2dae0a8b63c7"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49396
I20260808 05:59:33.976403 27613 log.cc:824] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:33.979570 27613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: No bootstrap required, opened a new log
I20260808 05:59:33.984294 27613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } }
I20260808 05:59:33.984639 27613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8a22519b5d3a4044b59bd3f0f54e1fd7, State: Initialized, Role: FOLLOWER
I20260808 05:59:33.985119 27613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } }
I20260808 05:59:33.985725 27636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:33.985875 27636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:33.986755 27613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [sys.catalog]: configured and running, proceeding with master startup.
W20260808 05:59:33.993520 27648 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:33.993619 27648 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:33.991966 27539 master_runner.cc:186] Error getting master registration for 127.2.191.126:40845: OK, instance_id { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" instance_seqno: 1786168773434320 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:59:33.995492 27539 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:59:34.084630 27451 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } attempt: 4
Aug 08 05:59:34 dist-test-slave-qg60 krb5kdc[27363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786168773, etypes {rep=17 tkt=17 ses=17}, kudu/127.2.191.126@KRBTEST.COM for kudu/127.2.191.124@KRBTEST.COM
I20260808 05:59:34.095810 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:34.085308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.2.191.124:40085 (local address 127.0.0.1:39802)
0808 05:59:34.085550 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 05:59:34.085567 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:59:34.085687 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:59:34.086030 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:59:34.086035 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:59:34.086291 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:59:34.086415 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:34.086422 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.087560 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.087564 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:34.088462 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:59:34.088475 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.089190 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.089194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:59:34.089286 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:34.089896 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:59:34.089912 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:59:34.091701 (+ 1789us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:59:34.094041 (+ 2340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:34.094045 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:34.094047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:34.094313 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:34.094645 (+ 332us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:59:34.094648 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:59:34.094650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:59:34.094749 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:59:34.095242 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:59:34.095245 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:59:34.095348 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 05:59:34.095464 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 05:59:34.095621 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260808 05:59:34.095918 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:34.085412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39802 (local address 127.2.191.124:40085)
0808 05:59:34.085566 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.085571 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.085630 (+ 59us) server_negotiation.cc:407] Connection header received
0808 05:59:34.085788 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.085791 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.085847 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.085958 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.086559 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.087414 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.088596 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.089036 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.089164 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:34.091861 (+ 2697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:34.091865 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:34.091868 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:34.091901 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:34.093917 (+ 2016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:34.094441 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:34.094446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:34.094447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:34.094545 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:34.094851 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:34.094856 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:34.094859 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:34.095121 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:34.095246 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:34.095551 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 05:59:34.095693 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:59:34.099808 27451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7: Bootstrap starting.
I20260808 05:59:34.102721 27451 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7: Neither blocks nor log segments found. Creating new log.
I20260808 05:59:34.103628 27451 log.cc:824] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:59:34.106012 27451 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7: No bootstrap required, opened a new log
I20260808 05:59:34.109151 27451 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } }
I20260808 05:59:34.109407 27451 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9af19afb56eb457e97ac2dae0a8b63c7, State: Initialized, Role: FOLLOWER
I20260808 05:59:34.109741 27451 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } }
I20260808 05:59:34.110411 27651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:34.110723 27651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:34.111153 27451 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:59:34.111232 27422 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 05:59:34.111366 27422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:34.112782 27422 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } }
I20260808 05:59:34.113842 27422 leader_election.cc:288] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [CANDIDATE]: Term 1 election: Requested vote from peers 9cc1a0c1f9ac4c248ea21f66a1671571 (127.2.191.125:40107), 8a22519b5d3a4044b59bd3f0f54e1fd7 (127.2.191.124:40085)
I20260808 05:59:34.115372 27585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7"
I20260808 05:59:34.115684 27585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:34.116406 27504 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571"
I20260808 05:59:34.116645 27504 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:59:34.117377 27585 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9af19afb56eb457e97ac2dae0a8b63c7 in term 1.
I20260808 05:59:34.118069 27504 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9af19afb56eb457e97ac2dae0a8b63c7 in term 1.
I20260808 05:59:34.118048 27397 leader_election.cc:302] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8a22519b5d3a4044b59bd3f0f54e1fd7, 9af19afb56eb457e97ac2dae0a8b63c7; no voters:
I20260808 05:59:34.119822 27651 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:59:34.120916 27651 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [term 1 LEADER]: Becoming Leader. State: Replica: 9af19afb56eb457e97ac2dae0a8b63c7, State: Running, Role: LEADER
I20260808 05:59:34.121346 27651 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } }
I20260808 05:59:34.129004 27651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9af19afb56eb457e97ac2dae0a8b63c7. Latest consensus state: current_term: 1 leader_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:34.129212 27651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:34.130921 27618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:34.118840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39814 (local address 127.2.191.124:40085)
0808 05:59:34.118961 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.118965 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.121126 (+ 2161us) server_negotiation.cc:407] Connection header received
0808 05:59:34.121321 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.121325 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.121375 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.121427 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.122460 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.123275 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.124423 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.124915 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.125039 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:34.127042 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:34.127047 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:34.127050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:34.127079 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:34.128889 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:34.129464 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:34.129470 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:34.129471 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:34.129567 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:34.129915 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:34.129921 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:34.129923 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:34.130171 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:34.130283 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:34.130647 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 05:59:34.130766 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260808 05:59:34.132606 27669 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:59:34.132718 27669 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:59:34.138180 27455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:34.119638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49406 (local address 127.2.191.126:40845)
0808 05:59:34.119747 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.119752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.129051 (+ 9299us) server_negotiation.cc:407] Connection header received
0808 05:59:34.129253 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.129258 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.129314 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.129369 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.130276 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.131012 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.132124 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.132518 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.132605 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:34.134375 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:34.134379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:34.134382 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:34.134408 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:34.136218 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:34.136828 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:34.136832 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:34.136833 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:34.136919 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:34.137219 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:34.137222 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:34.137223 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:34.137426 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:34.137547 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:34.137894 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 05:59:34.138022 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:59:34.142757 27533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:34.120433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33348 (local address 127.2.191.125:40107)
0808 05:59:34.120541 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.120545 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.131571 (+ 11026us) server_negotiation.cc:407] Connection header received
0808 05:59:34.131739 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.131742 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.131792 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.131840 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.132723 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.133484 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.136503 (+ 3019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:34.136892 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:34.136965 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:34.138812 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:59:34.138816 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:59:34.138818 (+ 2us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:59:34.138848 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:59:34.140639 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:34.141196 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:34.141200 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:34.141202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:34.141294 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:59:34.141636 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:59:34.141642 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:59:34.141645 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:59:34.141890 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:59:34.142023 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:34.142320 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 05:59:34.142448 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:59:34.145032 27674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:59:34.145946 27674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:59:34.155650 27585 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [term 1 FOLLOWER]: Refusing update from remote peer 9af19afb56eb457e97ac2dae0a8b63c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:59:34.158838 27672 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:59:34.164491 27636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9af19afb56eb457e97ac2dae0a8b63c7. Latest consensus state: current_term: 1 leader_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:34.164705 27636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:59:34.165534 27562 tablet.cc:2369] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:59:34.166213 27504 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [term 1 FOLLOWER]: Refusing update from remote peer 9af19afb56eb457e97ac2dae0a8b63c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:59:34.168437 27651 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:59:34.169859 27651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:34.169983 27651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:34.171571 27674 catalog_manager.cc:1347] Generated new cluster ID: 874b815a178543c0bfd6c1c4cb2b192f
I20260808 05:59:34.171634 27674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
W20260808 05:59:34.174258 27482 tablet.cc:2369] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:59:34.176201 27636 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:34.176337 27636 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:34.177577 27620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9af19afb56eb457e97ac2dae0a8b63c7. Latest consensus state: current_term: 1 leader_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:34.177748 27620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:34.177948 27677 mvcc.cc:205] Tried to move back new op lower bound from 7316147298932146176 to 7316147298805444608. Current Snapshot: MvccSnapshot[applied={T|T < 7316147298932146176}]
I20260808 05:59:34.182606 27674 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:59:34.183907 27674 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:59:34.190374 27651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:34.190532 27651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:59:34.191998 27620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9af19afb56eb457e97ac2dae0a8b63c7" member_type: VOTER last_known_addr { host: "127.2.191.126" port: 40845 } } peers { permanent_uuid: "9cc1a0c1f9ac4c248ea21f66a1671571" member_type: VOTER last_known_addr { host: "127.2.191.125" port: 40107 } } peers { permanent_uuid: "8a22519b5d3a4044b59bd3f0f54e1fd7" member_type: VOTER last_known_addr { host: "127.2.191.124" port: 40085 } } }
I20260808 05:59:34.192126 27620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:59:34.194713 27680 mvcc.cc:205] Tried to move back new op lower bound from 7316147298932146176 to 7316147298805444608. Current Snapshot: MvccSnapshot[applied={T|T < 7316147298932146176}]
I20260808 05:59:34.195663 27674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9af19afb56eb457e97ac2dae0a8b63c7: Generated new TSK 0
I20260808 05:59:34.196594 27674 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:59:34.226933 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.225262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33350 (local address 127.2.191.125:40107)
0808 05:59:34.225421 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.225425 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.225769 (+ 344us) server_negotiation.cc:407] Connection header received
0808 05:59:34.225944 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.225947 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.226000 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.226050 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.226791 (+ 741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33350: BlockingRecv error: recv got EOF from 127.0.0.1:33350 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
W20260808 05:59:34.226933 27455 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.224832 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49408 (local address 127.2.191.126:40845)
0808 05:59:34.225163 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.225168 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.225625 (+ 457us) server_negotiation.cc:407] Connection header received
0808 05:59:34.225879 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.225885 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.225947 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.226007 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.226791 (+ 784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49408: BlockingRecv error: recv got EOF from 127.0.0.1:49408 (error 108)
Metrics: {"server-negotiator.queue_time_us":200}
W20260808 05:59:34.226927 27618 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.225005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39830 (local address 127.2.191.124:40085)
0808 05:59:34.225141 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.225146 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.225709 (+ 563us) server_negotiation.cc:407] Connection header received
0808 05:59:34.225914 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.225917 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.225985 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.226041 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.226792 (+ 751us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39830: BlockingRecv error: recv got EOF from 127.0.0.1:39830 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 05:59:34.230896 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.229710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33354 (local address 127.2.191.125:40107)
0808 05:59:34.229826 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.229831 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.229936 (+ 105us) server_negotiation.cc:407] Connection header received
0808 05:59:34.230151 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.230154 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.230242 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.230341 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.230782 (+ 441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33354: BlockingRecv error: recv got EOF from 127.0.0.1:33354 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
W20260808 05:59:34.235216 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.234327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33360 (local address 127.2.191.125:40107)
0808 05:59:34.234448 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.234452 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.234463 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:59:34.234504 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.234507 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.234547 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.234647 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.235103 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33360: BlockingRecv error: recv got EOF from 127.0.0.1:33360 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260808 05:59:34.240103 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.238983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33372 (local address 127.2.191.125:40107)
0808 05:59:34.239108 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.239112 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.239249 (+ 137us) server_negotiation.cc:407] Connection header received
0808 05:59:34.239337 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.239340 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.239394 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.239489 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.239985 (+ 496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33372: BlockingRecv error: recv got EOF from 127.0.0.1:33372 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
W20260808 05:59:34.246992 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.245907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33374 (local address 127.2.191.125:40107)
0808 05:59:34.246112 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.246116 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.246214 (+ 98us) server_negotiation.cc:407] Connection header received
0808 05:59:34.246354 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.246357 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.246412 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.246507 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.246875 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33374: BlockingRecv error: recv got EOF from 127.0.0.1:33374 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
W20260808 05:59:34.258665 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.257364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33376 (local address 127.2.191.125:40107)
0808 05:59:34.257532 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.257538 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.257683 (+ 145us) server_negotiation.cc:407] Connection header received
0808 05:59:34.257872 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.257875 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.257936 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.258031 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.258537 (+ 506us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33376: BlockingRecv error: recv got EOF from 127.0.0.1:33376 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260808 05:59:34.278586 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.277187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33380 (local address 127.2.191.125:40107)
0808 05:59:34.277368 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.277372 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.277522 (+ 150us) server_negotiation.cc:407] Connection header received
0808 05:59:34.277730 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.277734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.277802 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.277913 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.278451 (+ 538us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33380: BlockingRecv error: recv got EOF from 127.0.0.1:33380 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260808 05:59:34.314419 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.313157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33390 (local address 127.2.191.125:40107)
0808 05:59:34.313340 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.313346 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.313500 (+ 154us) server_negotiation.cc:407] Connection header received
0808 05:59:34.313622 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.313626 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.313689 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.313800 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.314292 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33390: BlockingRecv error: recv got EOF from 127.0.0.1:33390 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
W20260808 05:59:34.381757 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.380599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33406 (local address 127.2.191.125:40107)
0808 05:59:34.380830 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.380833 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.380964 (+ 131us) server_negotiation.cc:407] Connection header received
0808 05:59:34.381085 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.381087 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.381142 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.381232 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.381654 (+ 422us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33406: BlockingRecv error: recv got EOF from 127.0.0.1:33406 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260808 05:59:34.513406 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.512070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33412 (local address 127.2.191.125:40107)
0808 05:59:34.512244 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.512249 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.512465 (+ 216us) server_negotiation.cc:407] Connection header received
0808 05:59:34.512635 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.512638 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.512690 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.512832 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.513269 (+ 437us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33412: BlockingRecv error: recv got EOF from 127.0.0.1:33412 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260808 05:59:34.772902 27533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:59:34.771634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33414 (local address 127.2.191.125:40107)
0808 05:59:34.771793 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:34.771799 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:34.771894 (+ 95us) server_negotiation.cc:407] Connection header received
0808 05:59:34.772097 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:34.772101 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:34.772157 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:34.772252 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:59:34.772786 (+ 534us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33414: BlockingRecv error: recv got EOF from 127.0.0.1:33414 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 05:59:34.973760 27633 catalog_manager.cc:1259] Loaded cluster ID: 874b815a178543c0bfd6c1c4cb2b192f
I20260808 05:59:34.973862 27633 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: loading cluster ID for follower catalog manager: success
I20260808 05:59:34.975793 27633 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: acquiring CA information for follower catalog manager: success
I20260808 05:59:34.977121 27633 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9cc1a0c1f9ac4c248ea21f66a1671571: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:59:34.994971 27648 catalog_manager.cc:1259] Loaded cluster ID: 874b815a178543c0bfd6c1c4cb2b192f
I20260808 05:59:34.995107 27648 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: loading cluster ID for follower catalog manager: success
I20260808 05:59:34.997062 27648 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: acquiring CA information for follower catalog manager: success
I20260808 05:59:34.998302 27648 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8a22519b5d3a4044b59bd3f0f54e1fd7: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:59:35.291549 27757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:35.287317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33418 (local address 127.2.191.125:40107)
0808 05:59:35.287592 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:35.287596 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:35.287611 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:59:35.287817 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:35.287821 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:35.287952 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:35.288076 (+ 124us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:35.288336 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.289087 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.289974 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.290232 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.290354 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:35.290685 (+ 331us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:35.291136 (+ 451us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:35.291281 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:35.291322 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 05:59:35.291380 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":93,"threads_started":1}
I20260808 05:59:35.299088 27763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:35.294663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39838 (local address 127.2.191.124:40085)
0808 05:59:35.294938 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:35.294943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:35.295095 (+ 152us) server_negotiation.cc:407] Connection header received
0808 05:59:35.295337 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:35.295340 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:35.295486 (+ 146us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:35.295624 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:35.295851 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.296433 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.297510 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.297754 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.297868 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:35.298223 (+ 355us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:35.298669 (+ 446us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:35.298818 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:35.298859 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 05:59:35.298916 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":84,"threads_started":1}
I20260808 05:59:35.306540 27757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:35.302563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33424 (local address 127.2.191.125:40107)
0808 05:59:35.302701 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:35.302706 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:35.302948 (+ 242us) server_negotiation.cc:407] Connection header received
0808 05:59:35.303009 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:35.303013 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:35.303074 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:35.303149 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:35.303401 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.304235 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.305309 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.305610 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.305709 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:35.305965 (+ 256us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:35.306056 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:35.306135 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:35.306304 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:59:35.306377 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:59:35.306869 27763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:35.302260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39850 (local address 127.2.191.124:40085)
0808 05:59:35.302407 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:35.302413 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:35.302914 (+ 501us) server_negotiation.cc:407] Connection header received
0808 05:59:35.303134 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:35.303140 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:35.303192 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:35.303270 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:35.303528 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.304303 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.305529 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.305851 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.305964 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:35.306397 (+ 433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:35.306474 (+ 77us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:35.306525 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:35.306686 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 05:59:35.306736 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:59:35.307753 27769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:59:35.302256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49410 (local address 127.2.191.126:40845)
0808 05:59:35.302518 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 05:59:35.302523 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:59:35.302817 (+ 294us) server_negotiation.cc:407] Connection header received
0808 05:59:35.303326 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:59:35.303330 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:59:35.303509 (+ 179us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:59:35.303626 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:59:35.303869 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.304479 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.305589 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:59:35.305934 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:59:35.306056 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:59:35.306481 (+ 425us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:59:35.307188 (+ 707us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:59:35.307282 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:59:35.307567 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 05:59:35.307634 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":89,"threads_started":1}
I20260808 05:59:35.310912 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 27376
I20260808 05:59:35.319892 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 27458
I20260808 05:59:35.328382 2813 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasklOEsuG/build/debug/bin/kudu with pid 27539
2026-08-08T05:59:35Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3328 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6650 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (297301 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST